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CHAPTER  I 


INTRODUCTION 


Nature  and  Scope  of  the  Problem 
Statement  of  the  problem.  — It  is  the  purpose  of 
this  study  to  construct  and  validate  an  instrument  to 
measure  musical  appreciation. 

Scope . — The  test  to  be  constructed  is  intended 
to  meet  the  need  for  measuring  the  musical  appreciation 
of  pupils  from  the  seventh  through  twelfth  grades  in 
the  secondary  schools,  and  of  students  in  college* 


Definition  of  Terms 

Music . — Music  has  been  defined  as  follows: 

Music  is  an  art  capable  of  establishing  and 
imposing  all  the  conditions  of  a distinctive 
emotion,  a distinctive  way  of  feeling,  but  in 
the  absence  of  the  object  or  circumstance  that 
gives  rise  to  that  way  of  feeling  in  ordinary 
life.  It  is  capable  of  doing  this  because  of 
the  expressive  means  it  employs.  It  uses  a 
medium,  the  medium  of  tone,  wnich  in  itself 
gives  rise  to  profound,  far-reaching,  and  com- 
manding emotional  and  organic  effects.  1/ 

The  essence  of  this  definition  is  that  music  is  an 

expressive  art. 


l/  James  L.  Mursell , Education  for  Musical  Growth,  Ginn 
and  company,  New  York,  1945,  p.l75. 
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Musical  appreciation.  — With  the  basic  definition 


of  music  as  an  expressive  art,  musical  appreciation  be- 
comes fundamentally  the  responsiveness  to  the  expressive 
ness  of  music.  As  Mursell  puts  it,  "There  is  only  one 
possible  basis  for  musical  discrimination,  and  that  is 
responsiveness  to  the  constitutive  values  of  the  art 
of  music."  i/ 

Higher  processes  of  musical  appreciation.  — While 
musical  knowledge,  including  technical,  historical,  and 
other  factual  information,  may  help  to  increase  an 
individual’s  sensitivity  of  response  to  music,  musical 
appreciation  is  far  more  than  the  mere  possession  of 
such  knowledge.  i?'or  the  purpose  of  this  study,  all 
the  factors  involved  in  musical  appreciation  other 
than  tnose  which  are  purely  informational  will  be  re- 
ferred to  as  the  higher  processes  of  musical  appreci- 
ation. 

Justification 

Ultimate  goal  in  the  teaching  of  music.  — The 
ultimate  goal  in  the  teaching  of  music  is  appreciation, 
"the  development  of  musical  responsiveness  which  is 
the  essence  of  musical  growth."  — ^ 


1/  ibid.,  p.  174 
2 / ibid.,  p.  150 
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How  results  are  tested.  — In  testing  tne  results 


of  music  education,  it  is  knowledges  which  are  tested, 
since  tnese  seem  to  be  tne  only  concrete  evidence  of 
achievement.  Since  musical  knowledge  represents  only 
one  phase  in  musical  appreciation,  testing  knowledges 
alone  does  not  seem  to  be  a completely  satisfactory 
method  for  estimating  musical  growth. 

Heed  for  a test  of  musical  appreciation.  — Since 
present  methods  of  testing  results  seem  to  be  inadequate, 
the  need  for  an  instrument  which  will  satisfactorily 
measure  musical  appreciation  becomes  evident.  The 
appreciation  of  music  involves  emotional  responses  which 
by  their  very  nature  are  personal,  and  likely  to  be 
highly  individual.  In  addition,  they  are  aesthetic  in 
nature  and  intangible  in  character,  i’or  these  reasons 
the  claim  has  been  made  that  musical  appreciation  can 
not  be  measured. 

On  the  other  hand,  the  educator  views  the  problem 
in  terms  of  successful  teaching.  While  he  may  entertain 
doubts  of  the  possibility  of  measuring  the  higher  processes 
of  musical  appreciation,  nevertheless  as  a teacher  he 
would  like  to  measure  results.  He  would  like  to  know 
whether  or  not  he  has  succeeded  in  inculcating  or  en- 
hancing the  musical  appreciation  of  the  students  under 
his  guidance,  and,  if  possible,  to  what  degree. 
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It  is  Thorndike’s  axiom  that  everything  that  exists 
exists  to  some  degree,  and  if  it  exists  in  some  degree 
it  can  be  measured,  With  this  as  a premise,  this  study 
will  be  devoted  to  the  construction  and  validation  of 
a test  which  will  measure  musical  appreciation  in  the 
secondary  schools  and  colleges. 

Design  of  the  Study 

The  study  can  be  divided  into  the  following  steps, 
each  of  which  will  be  described  in  a separate  chapter. 

a.  An  investigation  will  be  made  of  previous 
research,  experimentation,  and  testing  in  the  field  of 
musical  appreciation,  and  of  tests  of  appreciation  in 
the  allied  arts  of  literature  and  art. 

b.  The  factors  involved  in  musical  appreciation 
will  be  analyzed,  and  a multiple  choice  test  constructed 
with  sub-tests  for  each  of  the  various  factors.  All 

of  the  sub-tests,  with  the  exception  of  the  one  testing 
knowledges,  will  be  based  on  the  individual’s  response 
to  musical  stimuli. 

c.  The  test  will  be  given  to  a large  group  of  pupils, 
and  the  items  analyzed  for  discriminatory  power,  decoy 
value  of  the  choices,  and  relative  ease.  On  the  basis 

of  the  results  obtained,  worthless  items  will  be  dis- 
carded, and  the  test  will  be  refined. 

d.  The  test  will  be  given  to  a still  larger  group 
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of  pupils,  and  its  validity  established  by  correlating 
the  resulting  scores  with  a musical  experience  index 
which  is  to  be  used  as  a criterion. 

e.  A coefficient  of  reliability  will  be  obtained 
both  by  the  "split-half ,r  method  and  by  the  Kuder- 
Richardson  "Footrule" . 

f.  Percentile  norms  and  z and  T scores  will  be 
derived  and  tabulated,  and  an  interpretation  of  the 
tables  will  be  made. 

g.  A summary  of  procedures  and  results  will  be 
made,  with  possible  implications,  and  suggestions  for 


further  research 
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CHAPTER  II 


REVIEW  OF  PREVIOUS  RESEARCH 

General  Status  of  Previous  Findings 
Research  in  the  field  of  music  education  has  not 
kept  pace  with  research  in  other  fields  of  education. 
This  is  probably  due  to  the  fact  that  interest  has 
been  lacking  in  the  field  because  of  so  many  intangible 
factors  arising  when  studying  the  psychological 
aspects  of  teaching  music.  According  to  J.J.  Weigand,  i 
"The  lack  of  experimental  studies  in  music  education 
has  been  recognized  by  authorities  for  many  years, 
but  there  has  not  been  a significant  amount  of  attention 
given  to  it."  Max  Schoen  said  in  1935,  "I  counted 
some  300  experimental  studies  on  music  made  in  the 
last  ten  years;  not  one  bears  directly  on  school  music, 
and  not  one  of  them  is  by  a person  engaged  in  school 
mus i c . " 

It  is  true  that  many  studies  have  been  made,  and 
numerous  investigations  have  been  begun,  but  the  results 


l/  J.J.  Weigand,  "The  Scientific  Approach  to  Music 
Teaching",  Music  Educators  Journal,  Vol. XXXIII  (Nov. 
Dec.  1946) 
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have  not  been  followed  through  to  the  point  where  sig- 
nificant conclusions  can  be  drawn.  However,  although 
this  previous  research  reveals  no  definite  conclusions, 
trends  are  indicated  which  may  profitably  be  followed 
by  further  study. 


Early  Experiments 
(1892  - 1912) 

As  early  as  1892  an  experimental  study  was  made 
by  Gilman  i/  on  the  extent  to  which  a musical  com- 
position can  serve  adequately  as  a vehicle  of  expres- 
sion. He  carefully  chose  thirteen  violin  and  piano 
compositions,  and  had  each  played  before  an  audience 
of  thirty  non-professional  musicians,  asking  them 
to  answer  definite  questions  regarding  the  effect 
of  the  music  upon  them.  The  questions  chiefly  asked 
what  images,  stories,  moods,  emotional  backgrounds, 
main  impressions,  or  personal  characteristics  the 
music  suggested,  with  a few  questions  on  more  technical 
aspects  of  the  music.  There  was  great  diversity  of 
answers  when  the  questions  asked  for  images  and  stories, 
but  so  far  as  the  basic  moods  and  emotions  underlying 
the  music  were  concerned,  there  was  more  agreement.  2/ 

l/  3.1.  Gilman,  "Report  on  an  Experimental  Test  of  Musical 
Expressiveness",  American  Journal  of  Psychology,  1892, 

Vol.  IV.,  pp.  558-'bT6;  Vol.  V.,  pp'."'4'2-73 . 

2/  ibid.,  Vol,  IV.,  pp.  558-576. 
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The  aim  of  this  experiment,  as  stated  hy  oilman,  1/ 
was  a psychological  one  — to  find  out  what  it  is  that 
certain  selections  of  music  express.  There  was,  how- 
ever, an  interesting  hy-product,  and  one  which  is  of 
importance  to  the  present  study.  It  was  found  that 
while  the  audience  was  assumed  to  he  of  approximately 
equal  knowledge,  interest,  and  skill  in  music,  there 
proved  to  he  definite  differences  in  their  capacity  to 
detect  its  expressiveness,  — / 

In  a similar  experiment,  June  E.  Downey  in  1897 
had  twenty-two  persons  present  at  an  hour  and  one 
half  recital  of  six  piano  compositions.  Twenty-one 
of  these  people  had  no  musical  training  hut  showed  a 
fondness  for  music,  and  one  was  a professional  musician. 
After  each  composition  an  interval  was  allowed  for 
listeners  to  write  down  the  impressions  received 
from  the  music.  No  specific  questions  were  asked 
on  the  selections,  nor  were  the  titles  or  composers 
of  the  selections  given. 

Miss  Downey  3/  has  summarized  the  results  as 
follows : 


1/  ihid, , Vol.  V.,  p.  70. 

2/  ibid.,  Vol.  V.,  p.  72. 

3/  June  S.  Downey,  "A  Musical  Experiment”,  American 
Journal  of  Psychology,  1897,  Vol.  IX,  pp.  63-69. 
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As  conclusions  to  be  drawn  from  the  experiment 
as  a whole,  it  seems  possible  to  hold  provision- 
ally that  music  has  a somewhat  definite  emotional 
content,  and  that  impression  of  this  is  received 
by  the  average  listener,  out  with  varying  in- 
tensity. The  formal  content  seems  to  be  fur- 
nished entirely  by  the  mood,  associations,  or 
temperament  of  the  individual.  A great  dif- 
ference exists  both  in  the  capacity  of  the 
individuals  to  receive  definite  impressions 
and  of  composers  to  convey  them.  To  overcome 
a strong  individual  mood,  requires  music  of 
extremely  strong  expressiveness.  In  average 
passive  susceptibility  the  same  general  emotion 
is  aroused  with  varying  individual  emphasis 
on  different  sides  of  the  emotion.  The  dominant 
tone  is  usually  caught  and  held  to  the  exclusion 
of  subordinate  emotions. 

Ferrari  in  1899  and  Lahy  in  1904  came  to  similar 
conclusions  in  their  studies. 

A definite  physical  reaction  was  measured  by 
Shepard  in  1906  by  means  of  a plethysmograph. 

This  showed  that  agreeable  and  exciting  music  was 
invariably  attended  by  a more  rapid  pulse,  agreeably 
depressing  music  by  a shorter  pulse. 

In  1912  Harry  Porter  weld  carried  on  an  experi- 
mental study  of  musical  enjoyment.  In  this  study, 

Weld  used  a variety  of  musical  compositions,  and 
made  plethysmographic  and  pneumographic  records. 
However,  his  chief  aim  was  "to  obtain  a detailed 
and  accurate  description  of  the  mental  processes  which 
were  present  and  to  correlate  these  findings  with  the 


l/  J.F.  Shepard,  "Organic  Change  and  Feeling",  American 
Toumal  of  Psychology,  1906,  Vol.  XVII,  pp.  522-684. 
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type  of  observer  on  the  one  hand  and  with  the  type 
of  musical  composition  on  the  other." 

Weld  draws  the  following  conclusions  from  this 
study.  In  its  physiological  aspects,  listening  to 
music  is  accompanied  by  disturbances  in  the  distri- 
bution of  the  blood  supply,  increased  heart  rate, 
and  irregular  respiration.  Muscular  reactions,  too, 
were  found  to  be  of  great  importance  in  the  appreci- 
ation of  music. 

from  an  introspective  viewpoint,  the  enjoy- 
ment or  appreciation  of  music  is  a complex  experi- 
ence. The  various  factors  of  this  experience  are, 
a pleasurable  emotion  caused  by  the  timbres  of  in- 
struments and  their  nuances  of  tone,  a pleasurable 
reaction  to  the  rhythms  of  the  musical  compositions, 
pleasurable  association  inspired  by  past  experiences, 
pleasure  derived  from  auditory  and  visual  imagery, 
a pleasure  Die  mood  typical  of  any  emotion,  and 
intellectual  activity  consisting  of  the  analysis 
of  thematic,  rhythmic,  and  harmonic  structure,  and 
instrumentation  in  the  case  of  an  orchestral  per- 
formance, together  with  a keen  observation  of  skill 
or  lack  of  it  in  a player  or  singer. 


l/  Harry  Porter  Weld,  "An  Experimental  Study  of  Musical 
Enjoyment",  American  Journal  of  Psychology,  1912,  Vol. 
XXIII,  pp.  245-308. 
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This  study  further  shows  that  a great  deal  of 
variety  exists  in  the  type  of  listener.  Although 
in  actual  practice  an  individual  nay  shift  from  one 
type  to  another,  and  the  lines  of  demarcation  are 
not  well  defined,  the  main  types  were  found  to  he 
the  analytic,  the  motor,  and  the  imaginative.  The 
first  type  requires  the  deepest  concentration,  while 
the  imaginative  type  tends  to  he  more  passive.  By 
changing  the  degree  of  attention  the  listener  may 
change  from  one  type  to  another  at  any  time. 

Another  way  of  classifying  a listener  is  by 
the  degree  of  emotion  involved  in  his  reaction,  run- 
ning from  the  extremely  intellectual  or  coldly  criti- 
cal to  the  purely  sensory. 

These  early  experiments  in  music  were  carried  on 
from  the  point  of  view  of  the  psychologist,  rather  than 
the  music  educator.  While  these  experiments  did  not 
measure  musical  appreciation,  they  did  make  it  clear 
that  the  same  reactions  were  prevalent  in  response  to 
the  same  stimuli.  While  there  were  individual  differ- 
ences, there  was  sufficient  agreement  to  form  the  basis 
for  argument  that  appreciation  could  he  measured  to 
some  extent.  The  chief  weakness,  from  a measurement 
point  of  view,  lies  in  the  fact  that  the  free  responses 
that  were  called  for  can  not  he  measured  accurately 
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on  a scale.  However,  this  paved  the  way  for  the 
attempts  hy  contemporary  educators  to  establish  an 
instrument  which  would  satisfactorily  measure  these 
higher  processes. 


Later  Studies 
(1927  - 1942) 

In  the  teaching  of  music  appreciation,  it  is 
found  that  achieving  the  following  objectives  con- 
tributes to  its  development: 

Freedom  of  intellectual  and  emotional  response 
to  music;  familiarity  with  the  enduring  liter- 
ature of  music  through  singing,  playing,  and 
listening;  recognition  of  melodies,  rhythms, 
and  structural  forms;  habits  of  attentive 
listening;  sensitivity  to  tonal  color;  power 
to  create  musical  compositions;  dissatisfaction 
with  cheapness  and  vulgarity;  and  eagerness  for 
sincerity  and  beauty  of  expression.  ±/ 

One  of  the  factors  indicated  in  the  above  aims  is 

the  development  of  aesthetic  judgment.  One  of  the 

more  modern  contributions  in  the  measurement  of  musical 

appreciation  is  a test  of  aesthetic  judgment  which 

has  been  constructed  by  Kate  Hevner.  2/ 

In  this 

test,  the  listener  selects  his  choice  of  two  rendi- 
tions, one  of  which  is  an  original  form,  and  one  an 


l/  Lor in  F.  Wheelwright,  "Music  Appreciation",  Encyclopedia 
of  Modern  Education,  Philosophical  Library,  Inc.,  E'ew 
7orE  • 


2/  Kate  Hevner,  "Tests  for  Aesthetic  Appreciation  in  the 
"Field  of  Music”,  Journal  of  Applied  Psychology,  1930, 
Vol.  XIV,  pp.  470-477. 
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altered  form.  Since  it  is  assumed  that  the  composer's 
original  form  is  aesthetically  better  than  the  altera- 
tion, students1  choices  are  measured  against  this 
criterion.  While  this  marks  a great  advance  in  the 
right  direction,  its  scope  is  limited  to  only  one 
phase  of  musical  appreciation,  and  hence  can  not  be 
used  alone  as  a measure  of  appreciation  as  a whole. 

The  most  extensive  and  significant  work  in  the 
fields  of  both  music  and  appreciation  has  been  done 
by  Jacob  Kwalwasser,  both  alone  and  in  collaboration 
with  others. 

The  Kwalwasser  Test  of  Music  Information  and 
Appreciation  i/  purports  to  test  appreciation.  Since 
its  approach  is  chiefly  through  the  testing  of  know- 
ledges, it  is  questionable  how  accurately  appreciation 
is  tested,  although  appreciative  values  appertain  to 
information.  The  challenge  has  been  made  that  ,fit  is 
unfortunate  that  appreciative  types  of  outcomes  are 
not  subject  to  satisfactory  measurement."  2/ 

In  this  test  where  appreciation  is  involved,  the 

l/  Jacob  Kwalwasser,  Test  of  Music  Information  and 
Appreciation,  Bureau  of  Educational  Research  and  Service, 
University  of  Iowa,  Iowa  City,  1927. 

2/  Greene,  Jorgensen,  Gerberich,  Measurement  and  Evaluation 
Tn  the  Secondary  School,  Longmans,  Green  and  uo.,  Eew 
KorE/  1946 p.  44U. 
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question  can  be  raised,  "Are  we  measuring  musical  or 
non  musical  children?  Can  we  expect  results  in  both 
cases  to  be  conclusive,  tentative,  or  uncertain?" 
Raleigh  M.  Drake,  Associate  Professor  of  Psychology 
at  Wesleyan  College  in  Macon,  ceorgia,  has  this  to 
say  of  the  Kwalwasser  Test  of  Music  Information  and 
Appreciation: 

Although  a test  of  this  type  is  necessarily 
limited  largely  to  use  with  special  classes  who 
have  taken  a special  course  in  music  information 
(one  is  hardly  Justified  in  calling  it  apprecia- 
tion), this  test  covers  a wide  range  and,  because 
of  this  wide  sampling,  should  have  a satisfactory 
validity, 

Karl  W.  Gehrkins,  Professor  of  School  Music, 

Oberlin  College,  criticizes  the  Kwalwasser  test  as 
follows : 

The  purpose  of  this  test  is  to  determine  whether 
or  not  high  school  and  college  students  (who 
may  or  may  not  have  taken  a course  in  music  appre- 
ciation) have  acquired  a mass  of  information 
which  presumably  constitutes  at  least  a part  of 
what  is  termed  "music  appreciation".  The  material 
upon  which  the  student  is  tested  is  in  the  first 
place  selected  from  the  bias  of  the  instrumentalist 
who  has  but  little  sympathy  with  vocal  music;  and 
is  in  the  second  place  not  too  wisely  chosen  at 
best.  .Finally,  the  test  was  published  in  1927 
so  that  some  of  the  material  included  is  entirely 
out  of  date,  as  for  example,  its  reference  to 
artists  like  Calli  Curci,  Mary  Carden,  and  De 
Gogorza. 


l/  Oscar  Krisen  Buros,  Nineteen  Forty  Mental  Measurements 
Yearbook,  1940,  p.  1334. 


2/  ibid.,  p.  1336 
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But  an  even  more  serious  criticism  is  the  fact 
that,  Basically,  the  test  attempts  to  measure 
music  appreciation,  and  it  is  a grave  question 
whether  such  factual  material  as  this  has  much 
to  do  with  the  individual's  reaction  to  music. 
Certainly  the  pupil's  ability  to  recognize  the 
violin  as  a Bowed  string  instrument  and  the  oBoe 
as  a wind  instrument  is  worth  something  and  such 
knowledge  concerning  the  music  itself  will  un- 
doubtedly increase  his  appreciation.  But  whether 
the  statement  "Clara  Wieck  became  the  wife  of 
Schumann"  has  any  similar  effect  is  open  to 
grave  doubt. 

Our  chief  criticism  of  the  -cest,  then,  is  that 
it  is  not  valid.  It  tests  the  pupils  for  certain 
items  of  information  about  music  under  the  assump- 
tion that  these  constitute  an  important  ingredient 
in  music  appreciation.  But  it  would  Be  possible 
to  know  all  the  items  and  yet  not  appreciate 
music  at  all.  And  even  at  that  the  items  are  not 
well  chosen,  and  tne  test  would  have  to  be  drasti- 
cally revised  to  have  any  value  at  all  at  tnis 
time. 

These  criticisms  nave  Deen  quoted  at  great  length 
in  order  to  support  the  position  taken  in  this  study, 
which  is  identical  with  tnat  of  tnese  outstanding 
authorities.  Since  it  is  here  proposed  that  a test 

r 

Be  constructed  which  will,  it  is  noped,  measure  musical 
appreciation,  strong  criticism  of  anotner  test  in  the 
field  might  seem  too  heavily  weighted  witn  personal 
Bias,  unless  supported  by  the  objective  opinions  of 
qualified  authorities.  However,  Kwalwasser  himself 
has  admitted: 

It  is  so  much  easier  to  test  and  evaluate  written 
and  oral  work  dealing  with  note  values,  time  values, 
key  and  time  signatures,  rest  values,  and  so  forth, 
than  it  is  to  test  and  evaluate  the  appreciation 
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of  musical  Deauty  and  genuine  musical  performance, 
that  the  teacher  is  encouraged  to  do  the  former 
and  neglect  the  latter.  V 

Certainly,  in  attempting  to  measure  musical  appreci- 
ation by  means  of  a test  of  knowledges  alone,  Kwalwasser 
seems  to  have  ignored  the  fact  that 

Appreciation  of  any  art  is  an  attitude  which  is 
constantly  developing.  Growth  can  come  only 
through  ever-increasing  experience  with  more  and 
more  music  of  the  finest  quality.  It  is  measured 
by  the  student's  own  response  to  music,  and  non 
by  the  amount  of  factual  subject  matter  covered. 

In  the  past  ten  to  fifteen  years  some  research  has 
been  done  on  both  the  emotional  and  associational  meaning 
of  music  to  the  individual,  nigginson,  — / in  1936,  made 
a study  of  the  nature  of  associations  formed  wnen  listen- 
ing to  music  without  being  informed  of  tne  title.  The 
subjects  of  tnis  experiment  were  £00  boys  ranging  in  age 
from  ten  to  fourteen  years,  wno  were  asked  to  fill  in 
questionnaires  after  listening  to  six  recordings  of  differ- 
ent types  of  music.  The  results  indicated  three  different 
types  of  reactions:  those  evoked  by  tne  emotional  quality 

(mood)  of  the  music,  those  resulting  from  perceptual 


l/  Jacob  Kwalwasser,  Pro  Diems  in  Public  School  Music, 

I!.  Witmark  and  Sons,  l93£,  p.  17. 

2/  William  0.  hartshorn  and  nelen  S.  Leavitt,  Making  Priends 
with  Music  IfThe  Mentor",  Ginn  and  Company,  1940,  pp.  3-4. 

3 J J.H.  Migginson,  "The  Associational  Aspect  of  Musical 
Response  in  School  Children",  Journal  of  Sducational 
Psychology , October  1936,  Vol.  £7  , pp.  d7£-P80. 
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activity  (imagery),  and  those  produced  by  wandering 
thoughts.  These  results  are  consistent  with  those 
obtained  in  earlier  experiments. 

The  closest  recent  approach  to  testing  any  specific 
phase  of  musical  appreciation  appears  to  have  been  made 
by  Watson  1/  in  1942.  He  constructed  a test  of  adjective 
groups  describing  different  moods,  and  records  were 
picked  as  representative  of  the  adjectives.  The  sub- 
jects listened  to  the  recordings,  and  marked  the  word 
most  representative  of  the  meaning  to  them.  This  test, 
however,  in  measuring  the  discrimination  between  ab- 
stract meanings,  was  based  on  the  playing  of  entire 
recordings,  a procedure  not  too  well  adapted  for  class- 
room testing,  where  a large  enough  variety  of  recordings 
to  insure  a reliable  test  must  be  included  within  the 
time  limitations  of  the  average  class  period.  The 
chief  value  of  this  test  would  seem  to  lie  in  its  sub- 
stantiation of  the  fact  that  certain  reactions  to  music 
are  not  subjective  but  the  result  of  constant  factors, 
in  this  case  mood,  inherent  in  the  music  itself.  The 
conclusions  that  he  draws  are  directed  at  the  teaching 
of  musical  appreciation,  rather  than  its  measurement; 
he  establishes  the  fact  that  it  is  possible  to  teach 


l/  K.  Brantley  Watson,  "The  Nature  and  Measurement  of  Musical 
Meaning",  Psychological  Monograph,  1942,  Vol.  54,  No.  2. 
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the  understanding  and  appreciation  of  these  constant 
factors  in  music  even  to  those  unable  to  master  the 
technical  skills  of  musical  performance. 

These  studies  have  helped  to  formulate  more  def- 
initely the  conception  of  just  what  is  involved  in 
the  appreciation  or  music,  and  how  some  of  these  factors 
might  he  tested  and  an  individual’s  appreciation  eval- 
uated. However,  there  is  as  yet  no  known  standardized 
test  which  takes  into  consideration  all  of  these  factors, 
and  attempts  to  measure  an  individual’s  musical  appre- 
ciation on  the  basis  of  these  factors,  by  means  of  his 
reactions  to  musical  stimuli  as  well  as  his  possession 
of  musical  information. 


Tests  of  Appreciation  in  Allied  Arts 

Appreciation  has  been  defined  as  a product  of  learn 

ing  which  has  value  in  terms  of  feeling. 

It  is  the  personal  value,  the  worth,  the  satis- 
faction one  gets  from  experiencing  the  world  of 
things  about  him.  An  appreciation  connotes  an 
emotional,  as  opposed  to  a purely  intellectual, 
grasp;  one  may  have  technical  knowledge  and  under- 
standing of  a phase  of  his  environment  and  yet 
have  no  appreciation  of  it.  The  essence  of 
appreciation  is  feeling  or  emotional  warmth;  it 
is  the  desire  to  relive  a previous  experience 
or  have  a similar  one  that  is  emotionally  stim- 
ulating. i/ 


1 ./  Frank  A.  Butler,  "Appreciation”,  Encyclopedia  of  Modern 
Education,  Philosophical  Library,  Inc.,  i\lew  York,  T9 455, 

p.  4r0. 
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In  keeping  with  this  definition,  tests  have  been  de- 
vised in  doth  art  and  literature  which  test  certain 
phases  of  appreciation  in  these  allied  arts. 

Tests  of  appreciation  in  art.  — Two  of  the  out- 
standing tests  in  art  appreciation  are  the  Meier  Art 
Judgment  Test  and  the  McAdory  Art  Test.  — / 

In  the  Meier  Art  Judgment  Test,  published  in  1940, 
each  of  one  hundred  artistic  specimens  selected  with 
great  care  for  variety  of  elements  involved  in  aesthetic 
judgment  are  presented  to  the  pupils  in  two  forms  — 
the  original  form  and  a slightly  altered  form.  The 
pupil  is  told  what  the  difference  is  in  each  case,  and 
asked  to  select  the  form  more  pleasing  to  him. 

The  McAdory  Art  Test  is  similar,  but  asks  for 
reactions  to  a wide  variety  of  materials,  such  as  rugs, 
clothing,  and  furniture. 

Both  of  these  tests  are  scored  on  the  basis  of  the 
individual's  reactions  to  artistic  values,  and  hence 
are  measuring  appreciations,  not  factual  knowledges. 

Tests  of  appreciation  in  literature.  — In  the 
field  of  literature  there  are  a number  of  tests  which 
attempt  to  measure  appreciative  aspects.  Among  these 
are  the  Logasa-Wright  Tests  for  the  Appreciation  of 

l/  Greene,  Jorgensen,  Gerberich,  op.  cit.,  p.  445. 
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Literature,  the  uarroll  Prose  Appreciation  Test,  the 
Cook-Bixler  Literature  Appreciation  Tests,  the  Rigg 
Poetry  Judgment  Test,  and  the  Cooperative  Literary 
Comprehension  and  Appreciation  Test.— ^ The  last  two 
are  fairly  recent  contributions  in  the  field.  The 
Rigg  test,  published  in  1942,  uses  a technique  similar 
to  the  art  tests  described  above.  The  pupil  is  told 
to  select  what  he  considers  better  poetry  from  each 
pair  of  similar  (original  vs.  altered  or  paraphrased) 
selections  presented  to  him. 

The  Cooperative  Literary  Comprehension  and  Appreci- 
ation Test,  published  in  1941,  employs  various  techniques. 
One  of  these  is  the  selection  of  the  best  expressed 
sentence  from  a number  of  possible  choices,  which  is 
similar  to  the  procedure  in  the  tests  already  described. 
Another  technique  is  one  wnich  seems  well  adapted  for 
use  in  a music  appreciation  test.  This  consists  of  the 
presentation  of  a literary  excerpt  which  creates  a 
certain  mood,  and  asking  the  pupil  to  select  the  proper 
mood  from  the  five  choices  given. 

Conclusions 

It  seems  fairly  evident  that  while  progress  is 
being  made  in  the  testing  of  appreciation  in  art  and 


1/  ibid.,  p.  345 
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literature,  the  testing  of  musical  appreciation  is 
lagging  far  behind.  There  is  a definite  need  for  an 
instrument  which  will  measure  the  factors  involved  in 
the  appreciation  of  music. 

To  the  degree  that  such  a test  will  measure  these 
traits  individually  or  in  a group,  and  show  consistency 
in  results  in  repeated  testing,  it  will  be  a most  valu- 
able contribution  in  the  field  of  music  education. 

Appreciation  itself  need  not  depend  on  intelli- 
gence or  musical  training,  so  that  a measurement  of 
sensory  pleasure,  and  a feeling  of  mental  and  emotional 
rapport  plus  a projection  of  the  self  through  the  imagi- 
nation to  heights  of  sublimation,  may  be  the  crucial 
tests  of  music  appreciation. 

Mindful  of  the  difficulties  to  oe  encountered  in 
attempting  to  measure  on  an  objective  scale  something 
so  fraught  with  intangible  features  as  the  appreciation 
of  music,  but  encouraged  by  the  progress  made  in  the 
associated  fields  of  art  and  literature,  the  writer  has 
set  himself  the  task  of  constructing  and  validating 
an  instrument  to  measure  musical  appreciation. 
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CHAPTER  III 


PRELIMINARY  PROCEDURES 

Factors  Included  in  Musical  Appreciation 
Before  constructing  an  instrument  to  measure  musical 
appreciation,  it  is  necessary  to  define  tnat  which  is 
to  be  measured.  In  formulating  the  definition  of 
musical  appreciation,  the  various  factors  involved  must 
first  be  analyzed. 

The  outstanding  experiment  conducted  to  determine 
the  factors  involved  in  musical  appreciation  was  that 
of  Harry  Porter  Weld,  which  was  discussed  in  some 
detail  in  the  preceding  chapter.  His  conclusions  have 
stood  the  test  of  years;  Dickinson  in  192V  — and 
Mursell  in  1931  — / list  the  same  factors,  and  in  1948 
Mursell  again  emphasizes  these  factors  as  important  to 
musical  awareness.  — / 


l/  Edward  Dickinson,  The  Spirit  of  Music,  Charles  Scribner’s 
Sons , New  York,  1927,  pp.  70-73. 

2/  James  L.  Mursell  and  Mabelle  Glenn,  The  Psychology  of 
School  Music  Teaching,  Silver  Burdett  Co. , ivie'w  York, 

rssiTpp:  "lovf  m. — 

3 / Mursell,  op.  cit.,  pp.  133-136. 
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Mood.  — Mood  is  of  primary  importance 


"JSvery 


fine  musical  composition  and  indeed  every  fine  work  of 
art,  embodies  and  conveys  a distinctive  mood  or  way  of 
feeling,  and  does  so  clearly  and  convincingly.” 

"What  makes  certain  music  a joy  forever  io  us  as  indi- 
viduals and  also  to  succeeding  generations,  is  tne 
vitality,  sincerity  and  significance  of  its  Jiuman  feel' 

ing  and  the  clarity  with  wnich  that  feeling  is  ex- 

2/ 

pressed."  — It  nas  been  found  that  "when  numbers  of 
listeners  are  asked  to  ascribe  a meaning  to  a piece  of 


music,  they  fail  to  agree  as  to  a definite  story,  but 
agree  quite  closely  as  to  the  mood  involved."  3/ 

Imagery . — Another  vital  element  in  musical 
appreciation  is  imagery. 

Listening,  properly  conducted,  should  strengthen 
the  capacity  for  tonal  imagery  and  imaginative 
construction.  Listening  snould  hy  no  means  be 
considered  mere  passive  reception  — not  even  when 
the  main  consideration  is  the  evocation  of  a mood. 
The  successful  listener  enters  into  the  music, 
possesses  it,  is  possessed  by  it,  and  .so  is  inspired 
and  enabled  to  make  it  for  himself.  V 

Association.  — Association  enriches  appreciation. 


l/  James  L.  Mur sell,  Music  in  American  Schools,  Silver 
Hurdett  Go.  , New  York,  lV4 -.6,  p.  105. 

2/  ibid.,  p.  105. 

3/  ibid.,  p.  157. 

4/  ibid.,  p.  170. 
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While  a specific  musical  selection  may  create  a mood 
which  is  universally  agreed  upon,  the  associations 
aroused  in  the  listeners'  minds  are  much  more  individ- 
ual. Different  though  they  may  he,  without  them  some- 
thing is  lacking  in  the  individual’s  appreciation; 
with  them  the  music  has  much  more  meaning.  With  each 
repetition  more  associations  are  added,  enriching  the 
listener’s  background  and  experience  in  music,  and  so 
enhancing  his  appreciation.  "Whenever  we  present  a 
composition  either  for  listening  or  performance,  we 
do  well  to  capitalize  all  the  life-giving  associations 
naturally  connected  with  it." 

Rhythm.  — Rhythm  is  basic  to  any  musical  compo- 
sition. It  is  the  heart  of  the  music;  it  is  the  rhythm 
which  breathes  life  into  the  composition. 

We  do  not  believe  that  appreciation  can  be  properly 
taught  at  all  unless  the  element  of  rhythm  is  proper 
ly  handled  in  listening,  performing  and  creating. 

In  a great  deal  of  listening,  the  pupil  should  be 
encouraged  to  respond  to  the  rhythm  in  terms  of  free 
large,  bodily  movement,  stepping  it  out,  skipping 
or  dancing  to  it,  or  inventing  a rhythm  game.  By 
such  means  as  this  we  release  tne  rhythm  of  the 
music  as  a direct  source  of  natural  interest  and 
make  it  one  of  the  main  foundations  of  our  work  in 
appreciation.  £/ 

Timbre  of  instruments.  — Jlach  instrument  has  its 


l/  Mursell  and  Glenn,  op.  cit.,  p.  110 
2/  ibid. , p.  109. 
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own  particular  tone  color,  or  timbre.  The  listener  can 
derive  much  aesthetic  satisfaction  from  both  the  recog- 
nition of  the  timbres  of  the  instruments  and  from  the 
beauty  of  their  nuances  of  tone.  Thus  the  effect  of 
the  timbre  of  the  instruments  on  the  listener  is  an 
important  factor  in  appreciation. 

Factual  Knowledge.  — Authorities  vary  in  regard 
to  the  relative  importance  of  factual  knowledge  in  the 
appreciation  of  music , but  all  are  agreed  that  it  has 
its  place.  Intellectual  listening,  in  which  the  listener 
analyzes  the  style  and  structural  form  of  the  composi- 
tion is  definitely  dependent  on  the  individual's 
knowledge  of  such  matters.  The  appreciation  of  any 
musical  selection  is  enhanced  for  the  listener  with  a 
knowledge  of  the  history  of  music,  and  the  styles  of 
various  periods.  Whatever  additional  information  the 
individual  possesses  has  its  value,  for  the  more  one 
has  within  himself  to  bring  to  the  listening  of  music 
the  more  he  tends  to  derive  from  the  experience. 

Definition  of  Musical  Appreciation 

Using  the  aforementioned  psychological  aspects  as 

l 

a premise,  musical  appreciation  can  be  defined  as  that 
reaction  to  a musical  stimulus  that  sublimates  the 
emotions,  ideals,  and  thoughts  of  the  individual;  such 
reaction  involves  the  recognition  and  interpretation  of 
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the  mood,  associations,  imagery,  and  rhythm  of  the  music, 
combined  with  a feeling  for  the  timbre  of  instruments, 
and  a background  of  factual  knowledge. 

General  Structure  of  the  Test 

On  the  basis  of  this  definition,  this  study  was 
made,  to  construct  a test  to  measure  musical  appreci- 
ation in  the  secondary  schools  and  colleges.  In  order 
to  do  this,  a sub-test  was  constructed  on  each  of  the 
various  factors.  These  tests  are,  namely:  mood  re- 

action, imagery  and  association,  rhythmic  responses, 
feeling  for  the  timbre  of  instruments,  and  knowledges. 

The  first  four  tests  are  aimed  at  measuring  the 
higher  processes  of  musical  appreciation.  In  each  of 
these  four  tests  the  testee  listens  to  eighteen  recorded 
musical  examples,  selecting  from  four  possible  reactions 
to  eaoh  item,  one  which  best  describes  his  own.  For 
example,  in  Sub-test  I,  an  excerpt  from  TfIt  Is  Better  to 
Laugh  Than  Be  Sighing"  from  Lucrezia  Borgia  by  Donizetti 
is  played.  The  listener  then  chooses  the  mood  which 
best  describes  his  feeling  as  he  listened  from  the  four 
choices:  devotion,  sorrow,  peace,  joy.  The  best  selec- 

tion would  be  joy.  The  fifth  sub-test  consists  of  120 
multiple  choice  questions.  The  resulting  scores  are 
weighted  according  to  the  relative  value  of  the  various 
factors. 
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Choosing  the  Items 


Before  choosing  the  items,  an  analysis  was  made  of 
various  curricula,  including  those  of  such  representative 
cities  and  towns  as  New  York  City,  Salem,  Massachusetts, 
Needham,  Massachusetts,  and  Newton,  Massachusetts,  as 
well  as  universities  and  teachers1  colleges  such  as  Boston 
University,  Harvard  University,  New  York  University,  and 
Framingham  Teachers  College.  In  addition,  a survey  was 
made  of  various  texts,  including  Hartshorn  and  Leavitt's 
"Making  Friends  with  Music",  Kinscella's  "Music  and 
Romance",  and  such  music  series  as  "The  Singing  School", 
"Music  Hour",  "American  Singer",  and  "world  of  Music". 

A complete  list  of  these  will  he  found  in  the  bibliog- 
raphy. Since  music  appreciation  permeates  the  entire 
musical  program,  it  becomes  difficult  to  determine  time 
or  grade  placement  for  any  particular  item  of  knowledge 
or  degree  of  appreciation.  However,  despite  the  vari- 
ances of  placement  in  the  curriculum,  the  sum  total  of 
the  material  covered,  as  indicated  by  the  courses  of 
study  and  texts  surveyed,  remains  fairly  constant,  and 
in  addition,  it  is  safe  to  say  that  the  more  music  in 
all  its  aspects  with  which  one  is  saturated,  the  greater 
will  his  appreciation  be.  On  this  assumption  the  test 
was  constructed  to  measure  the  musical  appreciation  of 
students  from  the  seventh  grade  through  the  twelfth 
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grade  of  the  secondary  schools,  and  students  in  college 

as  well. 

Sub-test  I.  — Suh-test  I is  planned  to  measure  the 
ability  to  respond  to  a variety  of  moods.  Since  one 
musical  mood  stimulus  may  result  in  different  (though 
related]  responses  from  different  individuals  at  differ- 
ent times,  a test  calling  for  a free  response  was  not 
possible.  Instead,  four  choices  were  given;  one  choice 
almost  ridiculous  but  with  some  decoy  value,  a second 
closer  and  a little  more  tempting,  another  quite  close, 
and  a fourth  the  mood  as  described  by  the  composer  and 
confirmed  with  at  least  ninety  percent  agreement  by  a 
board  of  fifteen  experts  consisting  of  both  music  edu- 
cators and  professional  musicians,  without  reference 
to  composer  or  title  of  composition. 

Each  mood  is  represented  by  an  excerpt  or  leit- 
motive  of  a composition  written  to  suggest  the  particu- 
lar mood  in  question.  These  excerpts  were  played  on  tne 
piano  and  recorded  with  an  interval  of  ten  seconds  be- 
tween  excerpts  for  the  purpose  of  reading  the  choices 
and  marking  responses. 

The  vocabulary  difficulty  was  checked  with  Thorndike 
word  count.  No  word  that  was  Deyond  the  comprehension  of 
the  sixth  grade  level  was  used.  Excerpts  were  chosen  to 
cover  as  large  a range  of  moods  as  possible,  and  to  repre 
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sent  a wide  variety  of  composers,  and  still  oe  witnin  tne 
comprenension  of  the  secondary  school  population. 

Sub-test  II.  — Sub-test  II  is  planned  to  measure 
the  ability  to  select  appropriate  associations  and  images 
in  response  to  music  rich  in  suggestive  qualities.  The 
excerpts  were  selected  and  recorded  and  tne  multiple 
choices  selected  in  a manner  similar  to  tnat  used  in 
Sub-test  I.  However,  in  this  test  the  excerpt  was 
judged  for  suitability  on  its  ability  to  bring  to  mind 
a certain  association,  or  paint  a vivid  picture.  Most 
of  these  excerpts  were  taken  from  compositions  whose 
titles  were  the  same  or  closely  suggested  the  correct 
responses,  but  once  again  each  had  to  stand  the  test 
of  ninety  percent  agreement  on  the  part  of  the  board  of 
experts . 

Sub-test  III.  — Sub-test  III  is  planned  to  measure 
the  ability  to  react  to  various  rhythmic  stimuli.  The 
excerpts  and  multiple  choices  were  selected  as  in  the 
first  and  second  sub-tests,  the  excerpts  being  chosen 
for  their  strong  rhythmic  appeal  suggestive  of  a def- 
inite type  of  motion. 

Sub-test  IV.  — Sub-test  IV  is  planned  to  measure 
the  ability  to  identify  instruments  by  means  of  their 
timbre.  This  test  is  divided  into  three  sections.  In 
the  first,  the  choir  or  family  of  instruments  of  which 
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the  instrument  heard  is  a member  must  he  selected.  In 
the  second  section,  the  instrument  must  be  selected  from 
choices  among  instruments  of  various  choirs  or  families. 

In  the  third  section,  the  instrument  must  be  selected 
from  choices  of  instruments  within  the  same  choir  or 
family. 

Sub-test  V.  — Sub-test  V is  planned  to  measure 
the  grasp  of  musical  knowledges  and  understandings  which 
contribute  to  a fuller  appreciation  of  music.  It  was 
for  the  selection  of  the  items  for  this  test  that  the 
survey  of  curricula,  texts,  and  song  books  was  partic- 
ularly necessary  and  valuable.  After  the  items  were 
selected,  they  had  to  pass  the  scrutiny  of  the  group  of 
experts,  who  examined  them  all  very  carefully.  The 
items  chosen  sample  the  knowledges  and  understanding  of 
the  forms  and  styles  of  music,  history  of  music,  and 
general  musical  information  which  would  enhance  the 
appreciation  of  music. 

Preliminary  Testing 

After  the  five  sub-tests  were  constructed,  they  were 
given  to  a sampling  of  various  grades  as  an  additional 
check  on  the  selection  of  items  and  the  vocabulary  used 
in  the  responses.  It  was  found  that  despite  the  careful 
checking  with  Thorndike's  word  list,  here  and  there  a word 
appeared  which  was  beyond  the  comprehension  of  the  pupils. 


. ■»  4 

: ..I  , < ' 

«•  ' ' " • 1.1  . 

*10  • o 'S  t & sor-  • ..  > v • - 

. 


--  ... 

. . ■-  - - ci  i.*. ,lnoo;<. 


-•  ; • u , * *j.c  v •«  -ii/a 


. 

» < 

. 


1$  stT  v*i  * r ! :J  :*ri  i 

e i . , •> 

" * (i  • ■ 


vJ  6 OJ  Ce<Vl*i 


, •;  ; t r‘.  t . :J:  ■ ij:  . lev-  .. 

, ■ '■ 

„ 


. 


. 


1 : : l ‘ ' Jt  v • ' : •• 

: rtc  '?hj  rbw  (rlolrlv  . ti.-oqqa 


These  words  were  eliminated,  and  words  within  their  ex- 
perience and  understanding  were  substituted.  Not  included 
in  this  process  were  the  names  of  dances  in  the  last  part 
of  Sub-test  III,  and  any  musical  terms  or  expressions  used 
in  Sub-test  V,  which  as  subject  tool  words  should  be  part 
of  the  pupils'  experiential  background. 

In  this  preliminary  testing,  it  was  found  that  a 
certain  few  of  the  incorrect  responses  were  selected  with 
great  consistency  in  confusion  with  the  correct  responses. 
These  incorrect  choices  were  revised  to  eliminate  any 
ambiguity. 

When  these  preliminary  refinements  were  completed,  the 
test  as  a whole  was  ready  to  be  given  to  a large  group  of 
pupils  for  purposes  of  item  analysis  and  final  revision, 
after  which  it  would  be  given  to  a still  larger  group  of 
pupils  to  establish  its  validity  and  reliability,  and  to 
derive  norms  for  its  use.  Each  of  these  steps  was  con- 
sidered to  be  of  sufficient  importance  to  warrant  a 
separate  chapter.  The  chapters  that  follow  are  devoted 
to  a description  of  these  procedures,  a tabulation  of 
data,  and  a discussion  of  results. 
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CHAPTER  IV 


ITEM  ANALYSIS  AND  TEST  REFINEMENT 
Definition  of  Terms 

No  matter  how  carefully  a test  is  constructed,  it 
is  likely  to  contain  some  items  which  have  insufficient 
discriminating  value.  To  detect  these  worthless  items, 
it  is  necessary  to  administer  the  test  to  a sufficiently 
large  sample,  and  evaluate  each  item  on  the  basis  of  the 
responses  to  it.  This  item  analysis  is  an  analysis  of 
each  item  in  the  test  hy  appraising  the  responses  to  it 
with  respect  to  certain  standards  to  determine  the  decoy 
value  of  each  of  the  choices,  the  discriminating  power 
of  the  item  or  its  measure  of  significance,  and  its  order 
of  difficulty  in  an  index  of  ease. 

By  decoy  value  is  meant  the  attractiveness  of  each 
of  the  multiple  choices;  any  choice  which  receives  no 
response  is  worthless. 

By  the  discriminating  power  of  an  item  is  meant  the 
ability  of  the  item  to  differentiate  between  degrees  of 
the  quality  being  tested  (in  this  case  musical  appreci- 
ation) possessed  by  the  pupils  taking  the  test.  There 
are  various  tests  of  significance  which  can  be  employed 
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to  determine  this  discriminating  power. 

In  order  to  obtain  an  index  of  ease,  the  items  are 
arranged  in  order  or  difficulty  as  indicated  by  the  per- 
cent  of  pupils  giving  the  correct  response  to  each  item. 

Administration  of  the  Test 
The  test  of  musical  appreciation  was  given  in  its 
experimental  form  for  purposes  of  item  analysis  to  400 
pupils  in  the  seventh  through  twelfth  grades  of  secon- 
dary schools  in  Needham,  Massachusetts  and  New  York 
City.  Because  of  the  nomogeneous  grouping  of  pupils, 
it  was  possible  to  give  the  test  to  pupils  in  the  lower, 
middle,  and  upper  divisions.  The  mean  I Q of  the  pupils 
tested  was  103.0,  with  a standard  deviation  of  13.93. 

All  I Qs  were  obtained  from  a recent  administration  of 
the  Otis  Quick  Scoring  Mental  Ability  Test. 


Table  1 

I Q of  400  Cases  Tested  for  Item  Analysis 
Range  and  Mean  I Q for  -Each  Grade  Tested 


Grade 

Range 

Mean  I Q 

7 

65  - 139 

103.3 

8 

66  - 135 

102.9 

9 

64  - 132 

102.4 

10 

74  - 130 

102.5 

11 

76  - 130 

103.3 

12 

79  - 133 

103.7 

Total 

64  - 139 

103.0 
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To  allow  for  those  items  wnich  would  have  t;o  oe 


eliminated  as  a result  of  the  item  analysis,  the  rest 
was  constructed  with  one  third  more  items  than  were  de- 
sired ror  the  final  form.  The  rest  was  given  in  two 
parts:  Part  I,  including  tne  first  four  sub-tests  in 

which  tne  pupils  listened  to  the  recorded  excerpts  and 
marked  their  responses,  and  Part  II,  consisting  of  Sub- 
test V,  testing  knowledges.  Each  of  these  two  parts 
was  given  at  a separate  sitting.  Each  part  consisted 
of  a question  booklet,  containing  instructions,  sample 
questions,  and  choices,  and  an  answer  sheet  which  was 
to  oe  inserted  in  the  back  of  the  question  booklet, 
leaving  one  column  on  the  sheet  exposed  for  crossing  off 
in  the  proper  spaces  responses  to  the  questions  on  page 
one  of  the  booklet.  The  pages  of  tne  question  booklet 
were  graduated  in  size,  so  that  as  the  pages  were  turned, 
successive  columns  on  the  answer  sneet  were  exposed  for 
the  marking  of  responses.  This  form  is  identical  with 
that  of  the  final  form  of  the  test,  as  seen  in  Appendix  A. 

After  eacn  part  of  the  test  was  administered,  tne 
answer  sheets  were  removed  and  collected,  and  tne  question 
booklets  were  ready  to  be  reused.  The  answer  sheets  were 
corrected  by  means  of  a sanded  translucent  plastic  mask, 
and  all  responses  were  tabulated,  with  the  number  of  re- 
sponses to  each  cnoice  of  each  item  recorded. 


, ■ 

”1  ■ i.:  *2©  ri  X.,ai  ' 

, 

- t 

e :i  *:  o:: 

- , , 

< 

. &W 

< \ r:  . - 

, t . • 

t 00  etf 

■ • . ••  . f . ...  • a&.! 

t , 'rr<  » 

rrol  l>0coqx©  ©'row 

. 


•:  . . . ■ AOOtf 

c . • 


. 


©©.£'■ 


0 * i 


Decoy  Value  of  Items 


Upon  inspection  of  the  tabulated,  responses  to  each 
item,  it  was  found  that  each  choice  had  received  some 
responses,  and  so  had  some  decoy  value.  In  addition, 
the  relative  decoy  value  of  the  various  possible  choices 
for  each  item  closely  approximated  what  had  been  antici- 
pated in  selecting  the  choices  — the  least  likely 
choice  having  the  least  appeal,  and  the  choice  closest 
to  the  correct  one  having  the  most  appeal  of  the  three 
incorrect  choices.  As  a result,  little  change  in  the 
choices  was  necessary  in  the  final  revision  of  the 
test. 


Test  of  Significance  — Critical  Ratio 
Of  the  various  tests  of  significance  available  for 
determining  the  discriminating  power  of  an  item,  the  one 
used  in  this  study  is  that  involving  the  use  of  the 
critical  ratio.  To  apply  this  test,  two  groups  of 
responses  were  compared  — those  made  by  pupils  whose 
total  scores  were  in  the  highest  quartile,  and  those 
made  by  pupils  whose  total  scores  were  in  the  lowest 
quartile.  If  the  item  under  consideration  has  good  dis- 
criminating power,  a much  higher  percent  of  pupils  in 
the  highest  quartile  can  be  expected  to  choose  the  cor- 
rect response  to  the  item  than  the  percent  of  pupils  in 
the  lowest  quartile  choosing  the  correct  response. 
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Some  of  this  difference  could  be  due  to  chance.  It 
thus  becomes  necessary  to  apply  a test  of  significance 
to  determine  whether  the  difference  is  more  than  a chance 
difference.  To  do  this,  a null  hypothesis  is  assumed,  — 
that  there  is  no  difference  between  these  percents  out 
that  attributable  to  chance.  Or,  as  Peatman  expresses 
it,  "Any  Test  of  Significance  for  a difference  between 
two  statistics  is  a test  of  the  hypothesis  that  the 
parameter  difference  between  two  statistics  is  equal  to 
zero.  He  shall  characterize  all  such  hypotheses  as 
null  hypotheses • ” i/ 

Under  this  hypothesis,  it  is  assumed  that  the 
sampling  distribution  of  differences  is  normal,  and 
thus  will  follow  the  normal  probability  curve.  The 
justification  for  this  assumption  is  found  in  Peatman’s 
discussion  of  tests  of  significance  for  a difference 
between  any  two  statistics.  (In  this  case  the  two 
statistics  are  the  two  percents.)  According  to  Peatman, 
"When  the  samples  are  random  and  consist  of  £5  or  more 
cases  the  assumption  (that  it  is  a normal  distribution) 
regarding  the  sampling  distribution  of  differences  is 
usually  warranted  for  the  statistics  considered.”  2/ 

l/  John  Oray  Peatman,  Descriptive  And  Sampling  Statistics, 
harper  and  Brothers , wew  York,  1^47 , p.  401. 

2/  ibid.,  p.  403. 
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Since  tne  test  was  given  to  400  pupils,  representing  the 
various  ability  strata,  there  are  100  cases  in  each 
quartile,  more  than  enough  to  meet  the  requirements. 

In  this  normal  probability  curve,  the  parameter 
difference  (the  actual  mean  difference  of  the  hypothet- 
ical universe)  between  percents  is  zero.  Other  possible 
chance  differences  are  distributed  along  the  normal 
curve.  The  standard  deviation  of  this  distribution  is 
the  standard  error  of  the  statistic,  i.e.,  of  the  dif- 
ference of  percents. 

By  means  of  the  formulas 


where  p is  the  percent  (expressed  as  a decimal),  q r (1  - 
Ng  is  the  size  of  the  sample,  and  <Tp  is  the  standard 
error  of  the  percent,  and 


^px"py) 


where  <7“^p  p j is  s-fcan^ar<i  error  of  the  difference  of 

the  two  percents,  px  and  p , and  crp  is  the  standard 

y x 

error  of  the  first  percent,  p , and  <T 

X P'1 


is  the  standard 


error  of  the  second  percent,  p , we  can  compute  <T  , 

y iPx“Py ' 


1/  ibid.,  p.  354. 
2/  ibid.,  p.  404. 
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or  OtcL  cl  \,  the  standard,  error  of  the  difference  between 
w°x"/°y ' 

the  two  percents.  The  test  ratio,  T,is  expressed  as 
follows : 

rp  _ sample  difference  - parameter  diff.  of  zero  l/ 
standard  error  of"  "difference 


t = -i*,-  v--°- 

Expressed  in  the  terminology  used  in  the  preceding 
formulas,  this  becomes 

(pz  - Py> 

T * 

(PX-Py> 


2/ 


This  ratio  tells  how  many  standard  deviation  units 

away  from  the  mean  (parameter  difference  of  zero)  the 

sample  difference  of  percents  is. 

3/ 

From  tables  — ' based  on  knowledge  of  the  normal 
probability  curve,  it  can  be  seen  that  68 .E^>  of  the  area 
of  the  curve,  and  hence  68 .2°/>  of  the  frequencies,  lies 
between  the  meandzone  sigma.  Thus  only  31.8^>  of  the 
frequencies  lie  at  a distance  greater  than  one  sigma 
away  from  the  mean.  Similarly,  95.6 ft  of  the  frequencies 


l/  ibid.,  p.  403. 

2 j ibid.,  p.  404. 

3/  ibid.,  Appendix  .B  Table  1,  p.  508 
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lie  between  the  mean±.20’"  , leaving  only  4.4^>  further 
than  two  sigmas  away  from  the  mean.  In  like  manner,  it 
is  found  that  99 °/°  of  the  frequencies  lie  between  the 
mean ±2. 576(7"  , leaving  only  1 °/o  of  the  possibilities 
further  than  2.576  sigmas  away  from  the  mean.  In  other 
words,  in  a normal  distribution,  there  is  only  one 
chance  in  a hundred  of  the  occurrence  of  a case  2.576 
sigmas  or  more  away  from  the  mean. 

Interpreted  in  terms  of  tne  problem  under  discus- 
sion, the  test  ratio  (or  critical  ratio]  which  tells 
how  many  sigmas  away  from  the  parameter  difference  of 
zero  the  sample  difference  of  percents  is,  tells  how 
likely  it  is  that  such  a sample  difference  will  occur 
in  a purely  chance  distribution  of  differences.  If 
such  a likelihood  is  very  remote,  the  null  hypothesis 
can  be  rejected,  and  it  can  be  assumed  that  the  differ- 
ence in  percents  is  greater  than  that  wnicn  could  be 
attriouted  to  chance  alone.  In  other  words,  "the  dif- 
ference is  too  great  to  be  likely  on  the  basis  of  chance 
for  the  hypothesis  of  no  difference.”  — / 

In  any  particular  problem,  tne  ratio  which  indicates 
a sufficiently  remote  probability  with  respect  to  the 

l/  Frederick  C.  Mills,  Statistical  Methods  (Revised), 
henry  holt  and  Company,  New  York,  1958,  p.  471 

2/  Peatman,  op.  cit.,  p.  405-406. 
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statistics  under  consideration  is  chosen  as  a significant 
or  critical  ratio.  For  the  purpose  of  this  item  analysis 
it  was  decided  that  one  chance  in  one  hundred  — the 
so-called  Vfc  level,  which  is  indicated  by  a critical 
ratio  of  2.576,  was  sufficiently  unlikely  to  warrant  the 
rejection  of  the  null  hypothesis.  A critical  ratio 
greater  than  2.576  would  indicate  a still  more  remote 
possibility;  therefore  each  item  in  the  test  which  had 
a critical  ratio  of  2.576  or  more  was  judged  as  suffi- 
ciently discriminating  to  be  retained  in  the  test,  while 
those  with  a critical  ratio  of  less  than  2.576  were 
rejected  on  the  basis  that  the  differences  in  percents 
of  correct  responses  in  the  upper  and  lower  scoring 
groups  might  be  the  result  of  chance  alone. 

Using  C.R.  to  indicate  critical  ratio,  and  S.S.  to 
indicate  standard  error,  the  formula  becomes 


By  using  the  Sdgerton  tables  for  obtaining  directly  the 
values  of  the  standard  error  squared  for  each  percent  — ^ , 


l/  Harold  A.Edgerton  and  Donald  G.  Patterson,  "Table  of 
Standard  Errors  and  Probable  Errors  of  Percentages  for 
Varying  Numbers  of  Cases",  Journal  of  Applied  Psychology, 
Volume  10,  1926,  pp.  378-3917 


C.R 


difference  between  percents 
B.E.  of  difference 


difference  between  percents 


-- 


— - - 


; ; - ■ ' ' coq 
i ' 1 ' c , ■ 

-i- i± 

> . i I x £ rc  ritf 

. L 

at  l , * • 

f 


. 

' M 


t * - 


and  substituting  in  the  formula,  the  critical  ratio  for 
each  item  was  computed,  and  the  items  retained  or  re- 
jected on  the  basis  of  these  results. 

On  the  following  pages  is  a tabulation  of  all  the 
items  used  in  the  experimental  form  of  the  test,  with 
the  percent  of  correct  responses  in  the  highest  and  low- 
est quartiles,  the  difference  of  these  percents,  the 
standard  error  of  the  difference,  and  finally,  the 
critical  ratio.  The  last  two  columns  in  the  tables 
refer  to  the  index  of  ease,  and  to  the  number  of  the 
item  in  the  final,  revised  form  of  the  test. 

Index  of  Ease 

In  order  to  determine  the  relative  difficulty  of  tne 
items,  the  percent  of  the  400  pupils  answering  each  item 
correctly  was  computed  from  the  table  of  responses.  The 
item  receiving  the  highest  percent  of  correct  responses 
was  considered  the  least  difficult,  and  was  therefore 
number  one  in  the  index  of  ease.  The  item  receiving  the 
next  highest  percent  of  correct  responses  was  number  two 
in  the  index  of  ease,  and  so  on  to  the  most  difficult 
item,  that  which  received  the  smallest  percent  of  correct 
responses,  which  was  placed  last  in  the  index  of  ease. 

The  percent  of  correct  responses  to  each  item  is  indicated 
in  the  next  to  last  column  of  the  following  tables. 
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Table  2 

Item  Analysis  - Sub-test  I 

Discriminating  Power  and  Relative  Ease  of  Items 
Rased  on  400  Oases 


Item 

io  of  correct 
responses 

Diff.of  °/o 

s*s*Diff . 

0.  R. 

°/o  correct 
in 

400  cases 

Revised 
Wo.  of 
Item 

H 

L 

1 

70 

37 

33 

.066 

5.000 

52 

12 

2 

82 

43 

39 

.062 

6.290 

63 

10 

3 

94 

48 

46 

.055 

8.363 

77 

9 

4 

71 

47 

24 

.067 

3.582 

63 

5 

5 

91 

73 

18 

.053 

3.396 

87 

7 

6 

93 

72 

21 

.052 

4.038 

87 

1 

7 

70 

40 

30 

.067 

4.478 

57 

17 

8 

64 

40 

24 

.067 

3.478 

44 

18 

9 

82 

55 

27 

.063 

4.286 

69 

4 

10 

64 

53 

11 

.069 

1.594 

59 

* 

11 

81 

27 

54 

.059 

9.153 

56 

6 

12 

74 

41 

33 

.067 

4.925 

63 

16 

13 

85 

39 

46 

.061 

7.541 

71 

3 

14 

95 

71 

24 

.051 

4.706 

81 

2 

15 

85 

48 

37 

.062 

5.968 

71 

15 

16 

31 

27 

4 

.064 

0.625 

30 

17 

98 

87 

11 

.037 

2.973 

94 

Sample 

18 

26 

23 

3 

.063 

0.476 

30 

* 

19 

82 

33 

49 

.060 

8.167 

60 

11 

20 

60 

55 

5 

.070 

0.714 

57 

* 

21 

80 

72 

8 

.060 

1.333 

79 

* 

22 

94 

66 

28 

.053 

5.283 

85 

13 

23 

95 

69 

26 

.051 

5.098 

84 

8 

24 

96 

45 

51 

.054 

9.444 

79 

14 

* This  item  was  rejected  because  its  critical  ratio  fell 
below  the  significant  level  of  2.576  which  was  established 
as  a criterion. 


Table  3 

Item  Analysis  - Sub-test  II 

Discriminating  Power  and  Relative  Ease  of  Items 
Based  on  400  Gases 


Item 

°/o  of  correct 
responses 

Diff.of  /> 

S.S.Diff . 

G.  R. 

°/o  correct 
in 

400  cases 

Revised 
No.  of 
Item 

H 

L 

1 

95 

71 

24 

.050 

4.800 

87 

7 

2 

91 

64 

27 

.056 

4.821 

76 

14 

3 

74 

45 

29 

.067 

4.328 

61 

10 

4 

97 

67 

30 

.050 

6.000 

85 

13 

5 

85 

81 

4 

.053 

0.755 

84 

* 

6 

97 

67 

30 

.050 

6.000 

85 

2 

7 

58 

36 

22 

.069 

3.188 

48 

18 

8 

84 

77 

7 

.056 

1.250 

82 

Sample 

9 

91 

76 

15 

.052 

2.885 

85 

** 

10 

61 

33 

28 

.068 

4.118 

51 

17 

11 

88 

75 

13 

.054 

2.407 

84 

* 

12 

87 

62 

25 

.060 

4.167 

75 

3 

13 

72 

65 

7 

*066 

1.061 

68 

* 

14 

92 

77 

15 

.050 

3.000 

85 

8 

15 

41 

26 

15 

• 066 

2.273 

39 

* 

16 

75 

54 

21 

.066 

3.182 

70 

9 

17 

80 

34 

46 

.062 

7.419 

58 

16 

18 

87 

40 

47 

.060 

7.833 

67 

15 

19 

73 

39 

34 

.066 

5.152 

62 

20 

51 

30 

21 

.068 

3.090 

44 

12 

21 

66 

34 

32 

.066 

4.848 

53 

5 

22 

55 

48 

7 

.071 

0.986 

46 

* 

23 

83 

38 

45 

.062 

7.258 

66 

4 

24 

91 

54 

37 

.058 

6.379 

49 

6 

25 

68 

35 

33 

.067 

4.076 

52 

11 

26 

99 

86 

13 

.036 

3.611 

96 

1 

* This  item  was  rejected  because  its  critical  ratio  fell 
below  the  significant  level  of  2* **576  which  was  established 
as  a criterion. 

**  This  item  was  rejected  as  surplus. 
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Table  4 

Item  Analysis  - Sub-test  III 

Discriminating  Power  and  Relative  Jlase  of  Items 
Based  on  400  Gases 


-.r. 

Item 

°/o  of  correct 
responses 

Diff.of  % 

S‘^*Diff . 

C.  R. 

°jo  correct 
in 

400  cases 

Revised 
No.  of 
Item 

H 

IT 

1 

49 

35 

14 

.069 

2.029 

39 

2 

52 

27 

25 

.067 

3.731 

36 

6 

3 

73 

50 

23 

.067 

3.433 

61 

9 

4 

88 

63 

25 

.058 

4.310 

80 

8 

5 

87 

62 

25 

.060 

4.167 

76 

3 

6 

43 

28 

15 

.067 

2.239 

42 

* 

7 

16 

27 

11 

.057 

1.930 

22 

* 

8 

92 

66 

26 

.054 

4.815 

83 

7 

9 

65 

58 

7 

.069 

1.014 

63 

* 

10 

57 

29 

28 

.067 

4.179 

45 

5 

11 

96 

92 

4 

.034 

1.176 

95 

Sample 

12 

92 

72 

20 

.049 

4.082 

86 

1 

13 

72 

28 

44 

.064 

6.875 

59 

4 

14 

89 

63 

26 

.057 

4.561 

81 

2 

15 

88 

47 

41 

.059 

6.949 

72 

12 

16 

95 

60 

35 

.054 

6.481 

79 

11 

17 

41 

20 

21 

.063 

3.333 

30 

18 

18 

72 

37 

35 

.066 

5.303 

58 

15 

19 

96 

65 

31 

.052 

5.962 

83 

10 

20 

68 

62 

6 

.068 

0.882 

69 

* 

21 

80 

33 

47 

.062 

7.581 

63 

13 

22 

74 

40 

34 

.066 

5.152 

59 

14 

23 

55 

28 

27 

.067 

4.030 

42 

17 

24 

66 

32 

34 

• 066 

5.152 

47 

16 

* This  item  was  rejected  because  its  critical  ratio  fell 
below  the  significant  level  of  2,576  which  was  established 
as  a criterion. 
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Item  Analysis  - Sub-test  IV 

Discriminating  Power  and  Relative  Ease  of  Items 
Based  on  400  Oases 


Item 

°fo  of  correct 
responses 

Diff.of 

S.E.Diff. 

G.  R. 

f>  correct 
in 

400  cases 

Revised 
JMo.  or 
Item 

H 

L 

1 

98 

75 

23 

.045 

5.111 

83 

4 

2 

98 

81 

17 

.041 

4.146 

90 

1 

3 

97 

68 

29 

.050 

5.800 

87 

2 

4 

80 

60 

20 

.063 

3.175 

62 

if'j» 

5 

90 

66 

24 

.056 

4.286 

86 

3 

6 

77 

38 

39 

.065 

6.000 

48 

6 

7 

94 

46 

48 

.055 

8.727 

69 

5 

8 

96 

59 

37 

.053 

6.981 

81 

8 

9 

78 

63 

15 

.053 

3.148 

69 

10 

10 

96 

82 

14 

.043 

3 • 256 

82 

7 

11 

70 

38 

32 

.067 

4.776 

52 

12 

12 

83 

56 

27 

.063 

4.286 

63 

11 

13 

82 

44 

38 

.063 

6.032 

73 

9 

14 

54 

45 

9 

.071 

1.268 

52 

* 

15 

52 

5 

47 

.055 

8.545 

26 

18 

16 

74 

61 

13 

.066 

1.970 

62 

* 

17 

69 

37 

32 

• 066 

4.848 

54 

15 

18 

59 

27 

32 

.066 

4.848 

38 

17 

19 

65 

29 

36 

.066 

5.455 

50 

16 

20 

75 

35 

40 

.064 

6.250 

55 

13 

21 

74 

27 

47 

.062 

7.581 

53 

22 

67 

28 

39 

.065 

6.000 

45 

** 

23 

73 

37 

36 

.065 

5.538 

54 

14 

* This  item  was  rejected  because  its  critical  ratio  fell 
below  the  significant  level  of  2.576  which  was  establisnea 
as  a criterion. 

**  This  item  was  rejected  as  surplus. 
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Table  6 

Item  Analysis  - Sub-test  V 

Discriminating  Power  and  Relative  Ease  of  Items 
Based  on  400  Oases 


Item 

^ of  correct 
responses 

Diff.of  io 

S,S#Diff . 

G.  R. 

ft  correct 
in 

400  cases 

Revised 
No.  of 
Item 

H 

L 

1 

72 

30 

42 

.064 

6.563 

49 

10 

2 

82 

40 

42 

.062 

6.774 

58 

14 

3 

55 

13 

42 

.060 

7.000 

28 

12 

4 

82 

50 

32 

.063 

5.079 

72 

19 

5 

73 

43 

30 

.067 

4.478 

55 

15 

6 

73 

18 

55 

.058 

9.483 

38 

17 

7 

48 

43 

5 

.071 

0.704 

65 

* 

8 

46 

24 

22 

.066 

3.333 

35 

6 

9 

41 

27 

14 

.066 

2.121 

32 

* 

10 

73 

24 

49 

.062 

7.903 

47 

16 

11 

82 

42 

40 

.062 

6.452 

59 

8 

12 

68 

26 

42 

.064 

6.563 

40  , 

5 

13 

69 

40 

29 

.067 

4.328 

57 

3 

14 

35 

17 

18 

.061 

2.951 

23 

22 

15 

54 

41 

13 

.070 

1.857 

48 

* 

16 

54 

12 

42 

.059 

7.119 

27 

18 

17 

64 

27 

37 

.065 

5.692 

50 

4 

18 

46 

30 

16 

.068 

2.3  53 

38 

* 

19 

43 

32 

11 

.069 

1.594 

36 

* 

20 

92 

56 

36 

.057 

6.316 

79 

13 

21 

85 

49 

36 

.062 

5.806 

72 

2 

22 

75 

29 

46 

.062 

7.419 

52 

21 

23 

59 

26 

33 

.066 

5.000 

42 

25 

24 

48 

24 

24 

.066 

3.636 

59 

20 

25 

99 

£83 

16 

.039 

4.103 

91 

1 

26 

72 

42 

30 

.067 

4.478 

56 

9 

27 

95 

58 

37 

.054 

6.852 

84 

7 

28 

17 

11 

6 

.049 

1.224 

15 

* 

29 

74 

12 

62 

.044 

14.091 

40 

11 

30 

75 

29 

46 

.062 

7.419 

54 

24 

31 

79 

17 

62 

.056 

11.091 

43 

40 

32 

43 

20 

23 

.064 

3.594 

33 

36 

33 

62 

27 

35 

.066 

5.303 

43 

29 

34 

50 

25 

25 

.066 

3.788 

34 

** 

35 

81 

43 

38 

.063 

6.032 

70 

112 

36 

31 

24 

7 

.063 

1.111 

26 

* 

This  item  was  rejected  because  its  critical  ratio  fell 
below  the  significant  level  of  £.576  which  was  established 
as  a criterion. 


**  This  item  was  rejected  as  surplus. 
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'Table  6 
( continued) 


Item 

ft  of  correct 
responses 

Diff.of  ft 

s.s.Diff . 

C.  R. 

°/o  correct 
in 

400  cases 

Revised 
No.  of 
Item 

H 

L 

37 

59 

52 

7 

.070 

1.000 

61 

♦ 

38 

78 

38 

40 

.064 

6.250 

58 

26 

39 

59 

32 

27 

.068 

3.971 

70 

31 

40 

92 

70 

22 

.053 

4.151 

83 

23 

41 

74 

37 

37 

.065 

5.692 

55 

38 

42 

30 

18 

12 

.060 

2.000 

26 

¥ 

43 

49 

33 

16 

.069 

2.319 

46 

* 

44 

68 

40 

28 

.068 

4.118 

51 

28 

45 

25 

27 

2 

.062 

0.323 

26 

* 

46 

78 

38 

40 

.064 

6.250 

55 

32 

47 

48 

29 

19 

.067 

2.836 

39 

35 

48 

19 

27 

8 

.059 

1.356 

24 

* 

49 

79 

25 

54 

.059 

9.153 

53 

27 

50 

54 

26 

28 

.067 

4.179 

37 

41 

51 

70 

35 

35 

• 066 

5.303 

53 

33 

52 

76 

44 

32 

.066 

4.848 

62 

43 

53 

86 

49 

37 

.061 

6.066 

67 

37 

54 

69 

33 

36 

• 066 

5.455 

49 

34 

55 

79 

33 

46 

.062 

7.419 

54 

44 

56 

54 

16 

38 

.062 

6.129 

28 

42 

57 

48 

20 

28 

.064 

4.375 

34 

30 

58 

76 

22 

54 

.059 

9.153 

51 

39 

59 

68 

30 

38 

• 066 

5.758 

47 

65 

60 

19 

21 

2 

.057 

0.351 

23 

* 

61 

52 

19 

33 

.063 

5.238 

34 

49 

62 

50 

13 

37 

.060 

6.167 

26 

55 

63 

76 

15 

61 

.056 

10.893 

44 

52 

64 

29 

22 

7 

.061 

1.148 

25 

* 

65 

68 

34 

34 

.066 

5.152 

48 

45 

66 

60 

30 

30 

.067 

4.478 

45 

46 

67 

67 

28 

39 

.069 

5.652 

46 

51 

68 

50 

29 

21 

.067 

3.134 

43 

47 

69 

62 

25 

37 

.065 

5.692 

42 

53 

70 

54 

24 

30 

.066 

4.545 

35 

54 

71 

65 

27 

38 

.065 

5.846 

39 

48 

72 

90 

55 

45 

.058 

7.759 

25 

50 

* This  item  was  rejected  because  its  critical  ratio  fell 
"below  the  significant  level  of  2.576  which  was  established 
as  a criterion. 


Table  6 
( continued ) 


Item 

°fo  of  correct 
responses 

Diff.of  °jo 

3.2.Diff# 

0.  R. 

°/6  correct 
in 

400  cases 

Revised 
No.  of 
Items 

H 

L 

73 

84 

43 

41 

.062 

6.613 

68 

74 

74 

51 

27 

24 

.067 

3.582 

39 

60 

75 

71 

20 

51 

.064 

7.969 

34 

72 

76 

56 

39 

17 

.070 

2.429 

52 

* 

77 

54 

21 

33 

.065 

5.077 

41 

77 

78 

70 

38 

32 

.067 

4.776 

55 

75 

79 

87 

51 

36 

.060 

6.000 

70 

68 

80 

61 

37 

24 

.069 

3.478 

31 

67 

81 

46 

27 

19 

.067 

2.836 

38 

66 

82 

79 

29 

50 

.061 

8.197 

56 

58 

83 

64 

34 

30 

.067 

4.478 

51 

70 

84 

91 

42 

49 

.057 

8.596 

73 

56 

85 

63 

24 

39 

.064 

6.094 

45 

71 

86 

73 

41 

32 

.066 

4.848 

57 

69 

87 

72 

38 

34 

.067 

5.075 

53 

64 

88 

26 

20 

6 

.059 

1.016 

42 

* 

89 

54 

28 

26 

.067 

3.881 

31 

61 

90 

28 

20 

8 

.060 

1.333 

25 

* 

91 

83 

35 

48 

.061 

7.869 

59 

63 

92 

85 

44 

41 

.062 

6.613 

68 

57 

93 

54 

31 

23 

.068 

3.382 

48 

76 

94 

36 

25 

11 

.064 

1.719 

31 

* 

95 

92 

40 

52 

.056 

9.286 

73 

62 

96 

66 

27 

39 

.065 

6.000 

48 

59 

97 

96 

62 

34 

.053 

6.415 

82 

78 

98 

52 

45 

7 

.071 

0.986 

48 

* 

99 

69 

26 

43 

.064 

6.719 

51 

98 

100 

79 

31 

48 

.062 

7.742 

54 

80 

101 

72 

31 

41 

.064 

6.406 

48 

99 

102 

70 

29 

41 

.064 

6.406 

45 

94 

103 

65 

41 

24 

.069 

3.478 

50 

81 

104 

82 

49 

33 

• 063 

5.238 

44 

83 

105 

79 

34 

45 

.062 

7.258 

51 

92 

106 

81 

45 

36 

.063 

5.714 

62 

79 

107 

50 

28 

22 

.067 

3.284 

42 

73 

108 

66 

28 

38 

.065 

5.846 

47 

82 

* This  item  was  rejected  because  its  critical  ratio  fell 
below  the  significant  level  of  2.576  which  was  established 
as  a criterion. 
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Table  6 
l continued ) 


Item 

°jo  of  correct 
responses 

Diff.of  f 

3,E*Diff . 

C.  R. 

°jo  correct 
in 

400  cases 

Revised 
No.  of 
Items 

H 

L 

109 

72 

46 

26 

.067 

3.881 

57 

97 

110 

73 

44 

29 

.067 

4.328 

51 

86 

111 

85 

28 

57 

.058 

9.828 

59 

85 

112 

64 

21 

43 

.063 

6.825 

46 

88 

113 

94 

63 

31 

.054 

5.741 

81 

84 

114 

90 

55 

35 

.058 

6.034 

78 

90 

115 

81 

28 

53 

.060 

8.833 

58 

91 

116 

68 

35 

33 

.067 

4.925 

50 

93 

117 

57 

26 

31 

.067 

4.627 

42 

89 

118 

70 

36 

34 

.066 

5.152 

51 

87 

119 

52 

14 

38 

.061 

6.230 

29 

95 

120 

90 

44 

46 

.058 

7.931 

73 

96 

121 

49 

27 

22 

.067 

3.284 

36 

104 

122 

36 

7 

29 

,055 

5.273 

25 

117 

123 

97 

51 

46 

.053 

8.679 

79 

100 

124 

74 

26 

48 

.062 

7.742 

52 

119 

125 

47 

16 

31 

.062 

5.000 

30 

111 

126 

69 

30 

39 

.065 

6.000 

49 

102 

127 

48 

26 

22 

.067 

3.284 

32 

105 

128 

63 

17 

46 

.061 

7.541 

41 

114 

129 

9 

25 

-16 

.052 

-3.077 

18 

* 

130 

50 

30 

20 

.068 

2.941 

38 

109 

131 

29 

15 

14 

.058 

2.414 

19 

* 

132 

64 

17 

47 

.061 

7.705 

39 

120 

133 

45 

29 

16 

.067 

2.388 

31 

* 

134 

97 

53 

44 

.053 

8.302 

79 

106 

135 

91 

43 

48 

.058 

8.276 

68 

118 

136 

45 

24 

21 

.066 

3.182 

33 

116 

137 

89 

43 

46 

.059 

7.797 

61 

101 

138 

83 

40 

43 

.062 

6.935 

61 

107 

139 

63 

29 

34 

.066 

5.152 

45 

108 

140 

54 

26 

28 

.067 

4.179 

36 

115 

141 

52 

27 

35 

.067 

3.731 

39 

103 

142 

62 

23 

39 

.065 

6.000 

34 

no 

143 

42 

27 

15 

.066 

2.273 

28 

* 

144 

79 

26 

53 

.060 

8.833 

52 

113 

* This  item  was  rejected  because  its  critical  ratio  fell 
below  the  significant  level  of  2.576  which  was  established 
as  a criterion. 


Refining  the  Test 

The  first  step  in  refining  the  test  was  the  elimina- 
tion of  all  items  wnose  critical  ratio  was  less  than 
2.576.  The  results  of  applying  this  test  of  significance 
are  tabulated  helow. 

Table  7 


Table  of  Items  Retained  and  Rejected  in  Sub-tests 


Sub-test 

Original 
No.  of  Items 

No.  of  Items 
Below  Significant 
Level 

No.  of  Items 
Remaining 

I 

24 

5 

19 

II 

26 

6 

20 

III 

24 

6 

18 

IV 

23 

2 

21 

V 

144 

23 

121 

In  the  final  form  of  the  test,  in  order  to  meet  the 
time  limitations  of  the  average  40-45  minute  class  period 
for  each  part,  Part  I (Sub-tests  I-IV)  was  limited  to 
four  ten  inch  records,  one  record  for  each  sub-test. 

Since  9 excerpts  could  be  recorded  on  each  side  of  the 
record,  there  could  be  a maximum  number  of  18  items  in 
each  of  the  first  four  sub-tests.  Since  there  were  at 
least  18  acceptable  items  in  each  of  these  sub-tests, 
that  number  was  retained  in  the  final  form.  In  addition, 
an  even  number  of  items  was  desired,  to  facilitate  the 
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use  of  the  split-half  method  of  determining  the  relia- 
bility of  the  test.  Therefore  120  rather  than  the  entire 
121  items  were  retained  in  Sub-test  V. 

In  Sub-test  I,  the  item  with  the  highest  percent  of 
correct  responses  was  ’used  as  a sample,  leaving  the  re- 
quired 18  items.  Sub-test  III  had  exactly  the  required 
number  of  18  items.  In  the  remaining  sub-tests,  the 
items  with  the  lowest  critical  ratio  were  eliminated. 

As  a result,  there  are  only  four  items  in  the  entire 
refined  test  which  had  a critical  ratio  of  less  than 
3.0  — the  .1  °/o  level,  where  there  is  only  one  chance  in 
a thousand  of  the  difference  in  percents  being  caused 
by  chance  alone. 

The  items  which  were  finally  selected  for  use  in 
the  refined  test  were  numbered  within  each  sub-test  in 
order  of  difficulty;  the  least  difficult  being  number 
one.  In  order  that  the  pupil  will  not  become  discouraged 
while  taking  the  test,  as  he  might  if  the  items  became 
progressively  more  difficult,  the  items  were  arranged 
in  cycles  of  six.  Thus  every  group  of  six  questions 
begins  with  a relatively  easy  item,  and  the  items  in- 
crease in  difficulty  within  that  group.  iJ'or  example, 
if  the  items  range  in  difficulty  from  1 to  18,  the  order 
in  the  test  would  be  1,4,7,10,12,16,2,5,8,11,14,17, 
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When  the  final  form  of  the  rest  was  thus  determined, 
the  musical  excerpts  to  he  used  were  re-recorded,  and 
the  question  booklets  and  answer  sheets  were  mimeo- 
graphed. The  records  were  synchronized  with  the  question 
booklet,  so  that  when  a page  in  the  booklet  was  turned, 
the  record  was  turned  or  changed.  'The  directions  and 
sample  questions  for  each  of  the  first  four  sub-tests 
were  recorded  on  a special  record  of  directions,  as 
well  as  included  in  the  question  booklet.  This  helps 
to  eliminate  the  personal  factor  in  the  administration 
of  the  test.  In  addition,  a master  wire  recording  was 
made  of  the  entire  Part  I,  with  directions  and  sample 
preceding  each  sub-test. 

Weighting  the  Scores 

Since  it  is  agreed  among  music  educators  that  the 
various  factors  of  mood,  association  and  imagery,  rhythm, 
timbres  of  instruments,  and  knowledges,  have  different 
relative  values,  and  since  the  number  of  items  in  the 
first  four  sub-tests  are  the  same,  while  there  are  almost 
seven  times  as  many  items  in  the  fifth  sub-test,  it  be- 
came necessary  to  weight  the  scores  of  the  sub-tests  to 
give  each  factor  its  proper  value  in  the  measurement  of 
musical  appreciation. 

As  the  result  of  a questionnaire  answered  by  the 
board  of  experts  previously  referred  to,  tne  following 
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table  of  weighted  scores  was  unanimously  agreed  upon 


Table  8 

Table  of  Weighted  Scores  on  Sub-tests 


-- 

Sub-test 

Percent 
of  Total 

No.  of  Items 

Weight 

Weighted 

Score 

I 

30 

18 

4 

72 

II 

18 

3 

54 

III 

15 

18 

2 

36 

IV 

7-i. 
* 8 

18 

1 

18 

V 

25 

120 

i 

8 

60 

Total 

100 

240 

When  all  these  refinements  were  completed,  the  test 


in  its  final  form  was  ready  to  be  administered  to  a large 
sample  or  students  in  secondary  schools  and  colleges  for 
purposes  or  standardization. 


- u . ' 


( • 1 


. • 


: 


. 

■ 

. 


CHAPTER  V 


VALIDITY 

Definition  of  Terras 

The  most  important  characteristic  of  a good  test 
is  its  validity.  The  validity  of  a test  is  the  extent 
to  which  it  measures  what  it  purports  to  measure. 

Greene,  Jorgensen,  and  Gerherich  — ^ name  three  types 
of  validity:  psychological  and  logical  validity,  cur- 

ricular validity,  and  statistical  validity. 

Psychological  and  logical  validity  is  that  obtained 
from  a psychological  dissection  of  the  subject  being 
tested,  to  identify  as  many  as  possible  of  the  basic 
abilities  (or  factors)  involved.  This  is  best  done  be- 
fore constructing  the  test,  to  determine  what  factors 
to  consider.  In  this  study,  the  definition  of  musical 
appreciation,  which  enumerates  the  factors  involved, 
was  the  result  of  extensive  research  in  this  direction. 

Curricular  validity  is  that  obtained  from  a careful 
survey  of  curricula,  text  books,  writings  of  subject 
matter  specialists,  and  reports  of  national  or  regional 

l/  Greene,  Jorgensen,  and  Gerber ich,  op.  cit.,  pp. 55, 57, 60. 
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committees.  "The  idea  in  each  case  is  that  analysis 
of  these  source  materials  will  furnish  evidence  con- 
cerning the  thinking  of  qualified  educators  on  questions 
dealing  with  course  content,  emphases,  and  methods.” 

Such  a study  was  made  before  constructing  the  test,  as 
explained  in  the  chapter  on  preliminary  procedures,  and 
the  results  were  used  in  determining  the  important  out- 
comes to  test.  In  addition,  the  opinions  and  suggestions 
of  the  board  of  experts  previously  referred  to  were  taken 
into  consideration. 

Statistical  validity  is  that  obtained  by  statistical 
techniques.  Methods  frequently  used  involve  the  deter- 
mination of  the  correlation  between  test  scores  and 
some  outside  criterion  with  which  they  can  be  compared 
as  relative  measures  of  success  in  the  specific  field 
for  which  the  test  is  intended.  In  order  to  do  this, 
the  test  must  first  be  administered  to  a large  sample; 
the  criterion  to  be  used  for  comparison  must  be  decided 
upon,  and  the  correlation  between  the  scores  and  the 
criterion  must  be  computed.  The  rest  of  this  chapter 
will  be  devoted  to  a discussion  of  this  process,  and  the 
establishment  of  the  validity  coefficient. 


1/  ibid.,  p.  55 
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Sampling 


The  refined  test  of  musical  appreciation  was  admin- 
istered to  1008  students  from  the  following  cities  and 
towns:  secondary  schools  in  Arlington,  Revere,  Needham, 

Northbridge,  Vfhitensville , and  Upton,  Massachusetts,  and 
in  a large  New  York  City  high  school;  and  Framingham 
Teachers  College,  School  or  Education  or  Boston  University, 
and  College  of  Music  of  Boston  University.  The  various 
cities  and  towns  were  selected  to  give  a balanced  sampling 
of  urban,  suburban,  and  rural  population,  and  the  various 
social,  economic,  and  intellectual  strata.  The  pupils 
in  the  New  York  City  school  came  from  various  social, 
economic,  and  intellectual  backgrounds,  wnile  the  other 
cities  and  towns  counterbalanced  each  other  in  this 
respect.  In  addition,  lower,  middle,  and  upper  divisions 
were  tested  in  towns  wnere  homogeneous  grouping  was 
practiced.  The  college  groups  were  cnosen  to  include 
both  students  with  an  extensive  musical  background  and 
those  without  such  special  preparation.  The  1008  tests 
were  scored  and  the  results  tabulated.  These  results 
were  used  in  establishing  the  statistical  validity  of 
the  test,  and  later  in  determining  the  test’s  reliabil- 
ity, and  in  establishing  norms. 

Musical  Experience  Index 

The  criterion  used  in  determining  the  statistical 
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validity  of  the  test  was  an  index  of  musical  experience 
and  background.  On  each  answer  sheet  was  a questionnaire 
in  which  the  pupil  listed  the  nature  and  extent  of  such 
experience  and  background  as  it  fell  into  the  following 


categories:  elective  school  music  courses,  study  of  an 

instrument,  voice  training,  participation  in  band,  orches- 
tra, chorus,  and  choir.  Each  experience  was  given  a 
point  value  commensurate  with  the  extent  it  could  be 
expected  to  help  increase  musical  appreciation,  with  a 
maximum  point  value  for  each  type  experience,  as  indi- 
cated in  the  table  below. 

Table  9 

Point  Values  in  Musical  Experience  Index 

Type  of  Experience 

No.  of  Points 
per  year  of  study 

Maximum  No. 
of  Points 

First  instrument 

1 

5 

Second  instrument 

1 

3 

Voice  training 

2 

2 

Member  of  band 

2 

2 

Member  of  orchestra 
Member  of  chorus 

2 

2 

2 

2 

Member  of  choir 

1 

1 

Elective  music 

1 

5 

Total 

22 

. 
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The  maximums  were  set  for  instrumental  and  course 


study,  because  it  was  felt  that  the  law  of  diminishing 
returns  operates  after  a certain  length  of  time  in  a 
specialized  field  of  endeavor.  Thus  a pupil  with  parti- 
cipation in  various  musical  activities  could  be  expected 
to  grow  as  much  in  appreciation  as  one  wno  devoted  ten 
years  to  the  study  of  one  instrument  to  the  exclusion 
of  all  else,  no  matter  how  proficient  on  his  instrument 
he  may  have  become. 

For  purposes  of  establishing  the  correlation  be- 
tween this  criterion  and  tne  test  scores,  the  pupils 
were  divided  into  three  broad  classifications  on  the 
basis  of  their  musical  experience  index,  namely,  those 
with  meager  musical  experience  (an  index  of  0 - 1), 
those  with  moderate  musical  experience  (an  index  of  2 - 6 
and  those  with  extensive  musical  experience  (an  index 
of  7 - 22). 

In  the  absence  of  any  other  standardized  test  which 
satisfactorily  measures  musical  appreciation,  this 
musical  experience  index  proved  useful  in  making  a 
general  estimate  of  an  individual's  musical  appreciation 
in  terms  of  broad  classifications.  The  test,  if  proved 
valid  and  reliable,  will  provide  a means  for  measuring 
a pupil's  appreciation  much  more  accurately,  on  a def- 
inite scale  of  norms. 
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Table  10 


Frequency  Distribution 

of  1008  Scores  Grouped  by  Grade  and  Musical  Experience 


(Musical  Experience  Index:  x : Meager  y = Moderate  z = Extensive) 


Raw 

Grade 

7 

Grade 

8 

Grade 

9 

Grade 

10 

Grade 

11 

Grade 

12 

College 

Total 

Score 

0 

1-3 

4-22 

Total 

0 

1-3 

4-22 

Total 

0 

1-5 

4-22 

Total 

0-4 

5-7 

3-22 

Total 

0-4 

5-7 

8-22 

Total 

0-4 

5-7 

8-22 

Total 

0-4 

5-11 

12-22 

Tot, 

All 

X 

y 

z 

X 

y 

z 

X 

y 

z 

X 

y 

z 

X 

y 

z 

X 

y 

z 

X 

y 

z 

Grades 

215-221 

3 

3 

3 

208-214 

1 

1 

1 

1 

1 

1 

7 

7 

10 

201-207 

1 

1 

1 

1 

1 

1 

1 

1 

2 

12 

12 

17 

194-200 

1 

1 

1 

1 

2 

2 

3 

2 

7 

2 

15 

17 

27 

187-193 

2 

2 

1 

1 

2 

1 

2 

3 

3 

1 

2 

6 

3 

14 

17 

30 

180-186 

3 

3 

1 

3 

4 

3 

3 

3 

3 

1 

2 

2 

5 

7 

7 

13 

27 

6 

4 

10 

55 

173-179 

1 

1 

1 

2 

3 

1 

2 

3 

2 

2 

2 

2 

5 

9 

1 

6 

11 

18 

10 

6 

7 

23 

59 

166-172 

5 

5 

10 

3 

7 

10 

2 

1 

2 

5 

1 

2 

4 

7 

4 

10 

7 

£ 

13 

25 

3 

6 

2 

11 

78 

159-165 

3 

9 

12 

4 

11 

15 

2 

7 

10 

19 

3 

3 

1 

5 

1 

7 

5 

3 

4 

12 

9 

4 

13 

81 

152-158 

5 

4 

9 

1 

3 

12 

16 

2 

6 

13 

21 

5 

1 

6 

3 

5 

1 

9 

6 

4 

10 

5 

5 

2 

12 

83 

145-151 

3 

9 

12 

24 

4 

12 

11 

27 

3 

9 

12 

5 

7 

3 

15 

3 

1 

2 

6 

4 

2 

2 

8 

4 

5 

9 

m 

138-144 

6 

15 

10 

31 

6 

5 

7 

18 

_3_ 

6 

9 

2 

2 

4 

3 

3 

6 

X 

7 

9 

2 

11 

83 

131-137 

7 

12 

11 

30 

12 

14 

14 

40 

1 

4 

5 

2 

1 

2 

5 

6 

1 

7 

4 

1 

5 

4 

4 

96 

124-130 

6 

18 

7 

31 

11 

13 

5 

29 

1 

6 

5 

12 

4 

1 

5 

1 

1 

2 

i 

2 

3 

1 

1 

83 

117-123 

7 

18 

3 

28 

6 

4 

2 

12 

2 

4 

1 

7 

1 

1 

4 

4 

52 

110-116 

12 

16 

2 

30 

4 

7 

i 

12 

2 

2 

4 

4 

1 

5 

5 

5 

56 

103-109 

9 

11 

2 

22 

4 

3 

7 

i 

1 

2 

4 

4 

1 

1 

36 

96-102 

8 

10 

18 

4 

2 

6 

2 

i 

3 

1 

1 

28 

89-  95 

5 

4 

9 

3 

3 

1 

1 

1 

1 

1 

1 

15 

82-  88 

5 

1 

6 

1 

1 

1 

1 

8 

75-  81 

4 

1 

5 

1 

1 

6 

68-  74 

1 

1 

1 

N = 

73 

128 

69 

270 

56 

73 

77 

206 

13 

36 

62 

111 

29 

18 

18 

65 

26 

19 

19 

64 

57 

37 

48 

142 

45 

39 

66 

150 

1008 

M 

H 

H 

H 

H 1 

H 

H 

H 

(— 1 

H 

H 

M 

H 

H 

H 

H 

H 

H 

M 

H 

H 

1— 1 

H 

H 

M 

Mean  - 

M 

co 

CO 

CO 

03 

Cn 

03 

03 

cn 

03 

03 

03 

03 

03 

On 

<5 

<3 

03 

cn 

CO 

<3 

147 .51 

CO 

Ol 

<2 

o 

<3 

Cn 

03 

CO 

-0 

H 

CO 

cn 

Oi 

cn 

03 

CO 

O 

CO 

O 

cn 

cn 

03 

CD 

03 

W 

00 

00 

o 

H 

CO 

<1 

CO 

03 

Ol 

03 

cn 

M 

cn 

o 

03 

w 

-<3 

o 

co 

On 

<3 

o 

h-> 

03 

o 

o c 

= 28 . 28 

o 

H 

cn 

03 

03 

CD 

03 

CO 

H 

CO 

CO 

H 

03 

iP- 

co 

CO 

tp* 

03 

o 

oo 

H 

CO 

CO 

Ol 

03 

<i 

Table  11 


Frequency  Distribution 
of  1008  Scores 
in  Grouped  Grades 

with 

Medians,  Means,  and  Standard  Deviations 

and 

Standard  Errors  of  Means  and  Critical  Ratios 
of  the  Differences  between  Means 


Raw 

Score 

Grades 
7 Sc  8 

Grades 
9 & 10 

Grades 
11  & 12 

College 

Total 

215-221 

3 

3 

208-214 

1 

2 

7 

10 

201-207 

1 

1 

3 

12 

17 

194-200 

1 

2 

7 

17 

27 

187-193 

4 

9 

17 

30 

180-186 

7 

6 

32 

10 

55 

173-179 

4 

5 

27 

23 

59 

166-172 

20 

12 

35 

11 

78 

159-165 

27 

22 

19 

13 

81 

152-158 

25 

27 

19 

12 

83 

145-151 

51 

27 

14 

9 

101 

138-144 

49 

13 

10 

11 

83 

131-137 

70 

10 

12 

4 

96 

124-130 

60 

17 

5 

1 

83 

117-123 

40 

8 

4 

52 

110-116 

42 

9 

5 

56 

103-109 

29 

6 

1 

36 

96-102; 

24 

4 

28 

89-  95 

12 

1 

2 

15 

82-  88 

7 

1 

8 

75-  81 

6 

6 

68-  74 

1 

1 

N = 

476 

176 

206 

150 

1008 

; II 

Median 

132.2 

149.4 

167.9 

176.76 

147.3 

Mean 

131.76 

146.81 

163.75 

176.07 

147.51 

S.D. 

22.54 

23.31 

22.26 

22.05 

28.28 

s.e,m 

— 

1.03 

1.76 

1.55 

1.80 

.89 

C.R. 


M1-M2 


7.38 


7.21 


5.24 
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Table  10  shows  the  frequency  distribution  of  scores 
in  each  of  the  three  classifications  in  each  grade,  the 
total  frequencies  in  each  grade,  and  in  all  grades  com- 
bined, as  well  as  the  mean  of  each  distribution.  A 
glance  at  the  rable  shows  that  within  each  grade  the 
mean  becomes  higher  as  the  musical  experience  classi- 
fication becomes  higher,  indicating  that  a definite 
positive  correlation  exists.  Also,  the  mean  for  each 
grade  is  higher  than  that  of  the  previous  grade,  with 
the  exception  of  the  tenth  grade  where  a plateau  appears 
to  exist.  This  may  be  due  to  the  relatively  small  size 
of  that  particular  sample  obtained.  Therefore,  in 
Table  11,  grades  7 and  8,  9 and  10,  and  11  and  12  have 
been  combined  in  the  frequency  distributions,  which, 
with  the  college  group,  gives  four  grade  levels,  for 
which  the  means  and  standard  deviations  nave  been  com- 
puted. This  same  classification  was  used  later  in  set- 
ting up  norms. 


Statistical  Validity 

Jaspen  has  recently  (1946)  developed  formulas  for 
serial  correlation,  to  determine  the  correlation  between 
a continuously  distriouted  variable  and  one  segmented  or 
classified  into  a few  broad  classes.  The  formula  which 
is  used  in  this  study  is  his  formula  for  triserial  r. 
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for  the  linear  correlation  of  a continuously  distributed 
variable  with  a trichotomized  variable.  This  formula, 
as  given  by  Peatman,  is  as  follows: 


r 


tri 


yh“h  + (yc-VMc  - yA 


+ 


(y0-yh> 


where  1,  c,  and  h symbolize  the  three  classes  of  the 
segmented  variable,  i.e.,  1 is  the  lowest  part,  c is 
the  central  or  middle  part,  and  h is  the  highest  part; 

M , M , and  M.  are  the  respective  means  of  each  of  the 

ic  h 

segmented  groups  of  the  continuously  distributed  variable; 

c T is  the  standard  deviation  of  the  continuously  distrib- 
t 

uted  variable;  p^,  p^,  and  p^  are  the  respective  propor- 
tions of  the  total  group  in  each  of  the  three  segmented 
classes;  and  y^,  yQ , and  y^  are  the  respective  values 
of  the  ordinates  on  a normal  curve  at  points  that  divide 
the  total  distribution  into  three  parts,  with  the  pro- 
portion of  the  area  above  the  upper  point  of  division 

equal  to  p^ , and  the  proportion  of  the  area  between  the 
h 

lower  and  upper  point  of  division  equal  to  p . (The 

c 

ordinate  value  for  p.  is  always  zero  because  tnis  "point'1 

l 

l/  Peatman,  op.  cit . , p.  272. 
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Table  12 


Triserial  Correlation  of  Musical  Appreciation  Test  Results 
with  Criterion  Ratings  Trichotomized 


Criterion 

Total 

Test 

Ratings 

Group 

Scores 

L 

C 

H 

__T__ 

. 

fr. 

fh 

ft 

1* 

fl» 

c 

» fc* 

h» 

fh» 

t» 

ft* 

ft’2 

215-221 

3 

3 

6 

18 

10 

3C 

300 

208-214 

1 

9 

10 

9 

9 

5 

45 

9 

9C 

810 

201-207 

17 

17 

8 

4 

68 

8 

136 

1088 

194-200 

5 

22 

27 

7 

35 

3 

66 

7 

189 

1323 

187-193 

7 

23 

30 

6 

42 

2 

46 

6 

18  C 

1080 

180-186 

22 

33 

55 

5 

110 

1 

33 

5 

275 

1375 

173-179 

2 

25 

32 

59 

8 

16 

4 

100 

0 

0 

4 

236 

944 

166-172 

3 

38 

37 

78 

7 

21 

3 

114 

-1 

-37 

3 

234 

702 

159-165 

6 

51 

24 

81 

6 

36 

2 

102 

-2 

-48 

2 

162 

324 

152-158 

6 

52 

25 

83 

5 

30 

1 

52 

-3 

-75 

1 

83 

83 

145-151 

16 

65 

20 

101 

4 

64 

0 

0 

-4 

-80 

0 

C 

o 

138-144 

18 

55 

10 

83 

3 

54 

-1 

-55 

-5 

-50 

-1 

-83 

83 

131-137 

31 

53 

12 

96 

2 

62 

-2 

i-106 

-6 

-72 

-2 

-192 

384 

124-130 

31 

48 

4 

83 

1 

31 

-3 

-144 

-7 

-28 

-3 

-249 

747 

117-123 

25 

27 

52 

0 

0 

-4 

-108 

-8 

-4 

-208 

832 

110-116 

30 

25 

1 

56 

-1 

-30 

-5 

-125 

-9 

-9 

-5 

-28C 

1400 

103-109 

17 

19 

36 

-2 

-34 

-6 

-114 

-6 

-216 

1296 

96-102 

22 

6 

28 

-3 

-66 

-7 

-42 

-7 

-196 

1372 

89-  95 

11 

4 

15 

-4 

-44 

-8 

-32 

-3 

-120 

960 

82-  88 

6 

2 

8 

-5 

-30 

-9 

-18 

-9 

-72 

648 

75-  81 

6 

6 

-6 

-36 

-10 

-6C 

600 

68-  74 

1 

1 

-7 

-7 

-11 

-11 

, 121 

N = 

231 

505 

272 

1008 

<“+67 

& 

-180 

£=+177 

£ 

= -72 

£L6472 

Mt  = 

- 


M],  = 

- 

M 'h  - 


147.51 

28.28 


Criterion  Ratings  — Musical  Experience 
L — meager  experience  (0-1) 

C --  moderate  experience  (2-6) 
H — extensive  experience  (7-22) 


Inde 


120  + (.29)7  = 
148  - (.36)7  = 
176  + (.65)7  = 


122.03 

145.48 

180.55 


Pi 

Pc 

Ph 


231/1008 

505/1008 

272/1008 


.23 

.50 

.27 


n 

7c 

yh 


r 0 


304 

331 


tri  “ 


yhMh  + (yo-rh)Mc  - ycMl 


- 2 


(yc-yh)2 


4-  — 

Pi  J 


L?h  Pc 

.331(180.55) 4 (.304-. 331)145. 48-. 304 (122. 03) 


28.28 


.351  t (.304-. 331)2  f (.304)2 
.27  ' .50  .23 
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is  at  the  lowest  end  of  tne  distribution. ) 

‘Table  12  shows  the  computation  of  triserial  r, 
where  the  test  scores  are  the  continuously  distributed 
variable,  and  the  musical  experience  of  the  pupils  is 
the  trichotomized  variable.  As  the  result  or  this  com- 
putation, tne  validity  coefficient  is  seen  to  be  -^.82. 
Such  a correlation,  according  to  Greene,  Jorgensen,  and 
Gerberich,  ^ is  evidence  of  a marked  relationship. 

This  correlation  was  therefore  accepted  as  high  enough 
to  establish  the  fact  that  the  test  is  statistically 
valid. 

tfhile  this  high  validity  coefficient  establishes 
the  fact  that  the  test  measures  what  it  purports  to 
measure,  the  question  may  arise  whether  the  differences 
in  scores  ootained  by  the  pupils  might  not  De  due  to 
some  other  factor,  such  as  the  pupils’  intelligence 
quotients.  To  check  on  this  possibility,  a Pearson 
product-moment  correlation  was  made  between  246  seventh 
grade  scores  and  the  pupils’  intelligence  quotients, 
which  were  all  obtained  from  a recent  administration  of 
the  Otis  ^uick-Scoring  Mental  Ability  Test.  The  mean 
I Q was  found  to  be  104.7,  with  a standard  deviation 
of  14.14.  The  coefficient  of  correlation  was  found 


l/  Greene,  Jorgensen,  Gerberich,  op.  cit.,  p.  564. 
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to  be  -f-. 62 ±. .02.  </hile  this  shows  a positive  relation- 
ship, as  might  be  expected,  nevertheless  it  is  not 

sufficiently  high  to  indicate  that  this  test  is  a measure 

1/ 

of  intelligence.  — 

Since  the  test  consists  of  a number  of  sub-tests, 
each  purporting  to  measure  a different  factor  important 
to  musical  appreciation,  it  becomes  necessary  to  show 
that  these  sub-tests  are  not  measures  of  the  same  quality, 
such  that  one  could  be  used  as  a measure  of  all.  A low 
correlation  between  scores  obtained  in  the  various  sub- 
tests would  indicate  that  each  sub-test  does  measure  a 
different  factor.  Therefore,  intercorrelations  of  each 
sub-test  with  every  other  sub-test  were  computed,  by  means 
of  the  product-moment  method.  The  results  are  shown 
in  Table  13. 


Table  13 

Intercorrelations  of  Sub-tests 


II 

III 

IV 

V 

I. 

.43 

.42 

.39 

.45 

II. 

.39 

.42 

.50 

III. 

.40 

.43 

IV. 

• 56 

1/  ibid.,  p.  553 
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An  examination  of  Table  13  reveals  that  with  the 


exception  of  the  correlation  between  Sub-tests  IV  and  V, 
all  intercorrelation  coefficients  between  the  various 
sub-tests  range  from  .39  to  .50.  Applying  Kelley Ts 
formula  for  the  Coefficient  or  Alienation  k =Vl  - r2  i/ 
and  subtracting  the  results  expressed  as  percents  from 
100,  we  find  that  these  correlation  coefficients  range 
from  8 °/o  to  13^»  in  forecasting  efficiency.  The  somewhat 
higher  correlation  between  Sub-test  IV  (timbres  of 
instruments)  and  Sub-test  V (knowledges)  can  be  ac- 
counted for  by  the  fact  that  identification  of  the 
various  instruments  by  their  timbre  is  to  a certain 
extent  dependent  upon  some  knowledge  of  the  instruments. 
3ven  so,  the  correlation  coefficient  of  .56  between 
these  sub-tests  is  quite  low;  the  forecasting  efficiency 
being  only  17$>. 

These  results,  therefore,  indicate  that  while 
there  is  some  positive  correlation  between  the  various 
sub-tests,  it  is  not  high,  thus  refuting  the  hypothesis 
that  these  sub-tests  do  not  test  different  factors  in 
musical  appreciation. 

With  the  evidence  resulting  from  the  investigations 
described  in  this  chapter,  it  is  reasonable  to  conclude 
that  the  test  is  a valid  measure  of  musical  appreciation. 


l/  ibid.,  p.  564 
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CHAPTER  VI 


RELIABILITY 
Definition  of  Terifts 

Another  extremely  important  characteristic  of  a 
good  test  is  its  reliability.  The  reliability  of  a 
test  is  the  consistency  with  wnich  the  test  measures 
what  it  does  measure.  Thus  a test  can  be  reliable  with- 
out being  valid,  since  it  can  satisfactorily  test  what 
it  does  test,  without  testing  what  it  attempts  to  test. 
However,  a test  cannot  be  valid  unless  it  is  reliable, 
since  it  cannot  efficiently  measure  what  it  attempts  to 
measure  unless  it  efficiently  measures  what  it  does 
measure.  Hence  the  reliability  of  a test  is  an  aspect 
of  validity;  but  reliability  is  a general  characteristic 
of  a test,  while  validity  is  specific. 

The  reliability  of  a test  can  be  established  in 
various  ways,  each  resulting  in  a coefficient  of  correla- 
tion. Scores  on  two  equivalent  forms  of  the  same  test 
given  successively  by  the  same  procedure  to  the  same 
group  of  pupils  can  be  correlated  to  give  a reliability 
coefficient.  When  two  forms  of  the  test  are  not  availade, 
a retesting  coefficient  can  be  obtained  by  giving  the 
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test  twice  to  tne  same  group  of  pupils  under  similar 
testing  conditions,  and  correlating  tne  two  sets  or 
scores.  A third  metnod  of  obtaining  a coefficient  of 
reliability,  and  tne  one  which  has  been  employed  in  this 
study,  is  the  "split-half tf  procedure.  In  this  metnod, 
the  test  is  given  to  a group  of  pupils,  and  scores  are 
obtained  for  two  arbitrarily  determined  halves  of  tne 
test.  The  correlation  coefficient  obtained  between  the 
two  sets  of  scores  indicates  the  reliability  for  the 
test  if  it  were  half  as  long  as  the  original  test. 

Since  the  reliability  of  a test  will  increase  with  its 
length,  though  not  in  direct  proportion,  the  reliability 
of  the  test  as  a whole  can  be  found  by  means  of  the 
Spearman -Brown  Prophecy  Formula,  which  was  devised  for 
that  purpose. 

An  additional  method  of  estimating  test  reliability 
is  the  use  of  a special  formula,  requiring  only  the 
arithmetic  mean  and  standard  deviation  of  the  scores, 
and  the  number  of  items  in  the  test.  This  is  the  Kuder- 
Richardson  "Footrule" , so  called  because  it  gives  a 
coefficient  which  is  not  the  most  accurate  obtainable, 
however,  its  application  is  simple,  and  while  it  "may 
in  some  cases  be  an  underestimate  it  is  never  an  over- 
estimate of  the  reliability  coefficient."  — ^ 


1/  ibid.,  p.  63 
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"Split-Half”  Reliability  Coefficient 
The  coefficient  of  reliability  for  the  test  of 
musical  appreciation  was  obtained  by  the  "split-half” 
method,  using  201  scores  taken  at  random  from  the  entire 
1008  scores,  ‘i'o  obtain  this  random  sampling,  the  answer 
sheets  were  alphabetized  within  grades,  and  every  fifth 
paper  was  selected  for  use  in  the  calculations.  The 
two  halves  of  the  test  used  were  the  total  scores  re- 
ceived on  odd  numbered  items,  and  tne  total  scores 
received  on  even  numbered  items.  When  these  two  sets 
of  scores  were  correlated,  oy  the  pro duct -moment  metnoa, 
the  resulting  coefficient  was  rn  r ,93.  Applying  the 

S"2 

Spearman -Brown  Prophecy  Formula, 


12 


Er 


2JL 

22 


1 tr 


H 


12 


2(.93) 
1 -h  .93 


1.86 

1.93 


= .96 


This  gives  a reliability  coefficient  of  .96  for  the 
test  as  a whole,  which,  to  quote  Greene,  Jorgensen,  and 
Gerberich,  is  "evidence  of  unusually  high  reliability; 
scores  may  be  treated  with  confidence.”  i/ 


l/  ibid.,  p.  564 
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The  individual  sub-tests,  with  the  exception  of 
Sub-test  V,  are  too  short  to  indicate  very  high  relia- 
bility, particularly  when  the  18  items  are  divided  into 
two  parts  of  only  9 items  each  for  use  in  the  "split- 
half"  method.  However,  the  reliability  of  these  sub- 
tests can  be  argued  from  the  high  reliability  of  the 
test  as  a whole.  The  reliability  coefficient  was 
calculated  for  Sub-test  V,  and  found  to  be  .96. 

Kuder-Richardson  "Footrule"  Coefficient 
There  have  oeen  objections  to  the  use  of  the  "split 
half"  method  of  obtaining  a reliability  coefficient  on 
the  grounds  that  the  result  may  be  spuriously  high. 
Therefore,  since  it  is  never  an  overestimate,  the  relia- 
bility coefficient  of  the  test  was  computed  by  means  of 
the  Kuder-Richardson  "iJ'ootrule" , as  a check  on  the 
previous  results.  The  formula  is  as  follows: 

n (T%  - npq 

tt  - n - 1 

t 

where  p z ^ and  q r 1.00  - p,  and  where  M.  is  the 

n z 

arithmetic  mean  of  the  test  scores,  (T^  is  the  standard 
deviation  of  the  test  scores,  and  n is  the  number  of 
test  items. 

Substituting  in  this  formula,  and  using  the  entire 
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distribution  of  1008  scores  to  obtain  and  <T^ , a 
reliability  coefficient  of  r^  = .93  was  obtained. 
Though  not  quite  so  nigh  as  the  coefficient  obtained 
by  the  "split-half”  technique,  it  still  indicates  a 
very  high  reliability.  Referring  again  to  Greene, 
Jorgensen,  and  Gerberich,  it  is  seen  tnat  a relia- 
bility coefficient  of  .90  is  evidence  of  marked  relia^ 
bility;  therefore,  with  an  even  higher  reliability 
coefficient,  it  appears  to  oe  a reasonable  conclusion 
that  tnis  is  a reliable  test  of  musical  appreciation. 


l/  ibid.,  p.  064 
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CHAPTER  VII 


WORMS 

Definition  of  Terras 

Norms  are  tables  of  information  by  means  of  which 
test  scares  can  be  interpreted.  They  are  obtained  by 
giving  the  test  to  a large  and  representative  sampling 
of  pupils  in  the  same  grades  and  of  a type  similar  to 
the  groups  for  whom  the  test  is  intended.  When  a test 
is  given,  it  is  the  pupil Ts  performance  which  is  meas- 
ured. From  his  performance  on  the  test,  his  achieve- 
ment in  the  subject  being  tested  is  estimated. 

Tests  intended  for  use  in  the  secondary  school 
are  provided  with  percentile  and  grade  norms  more 
frequently  than  with  age  norms,  since  "increments  of 
growth  in  achievement  from  age  to  age  at  the  upper 
levels  are  relatively  not  significant."  — ^ In  accordance 
with  this  practice,  a table  of  percentile  norms  has 
been  derived  as  the  main  basis  for  interpreting  the 
raw  scores  obtained  by  pupils  in  the  test  of  musical 
appreciation.  As  used  here,  a percentile  norm  is  a 

l/  ibid.,  p.  85. 
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measure  of  the  position  or  rank:  of  a score  in  terms  of 
the  percent  of  pupils  in  a wide  sampling  whose  scores 
are  equalled  or  surpassed  by  the  score. 

In  addition,  a table  of  z scores  has  been  derived 
to  complement  the  percentile  table.  A z score  measures 
the  distance  of  a raw  score  above  or  below  the  mean  in 
terms  of  standard  deviation  units.  Since  z scores  in- 
volve fractions,  as  well  as  positive  and  negative  num- 
bers, as  the  raw  scores  are  above  or  below  tne  mean, 
in  the  table  the  scores  have  also  been  expressed  in 
terms  of  T scores.  These  _are  scores  based  on  a normal 
distribution  with  a mean  of  50  and  a standard  deviation 
of  10,  and  generally  range  from  20  to  80. 

Derivation  of  Worms 

The  entire  sampling  of  1008  cases  was  used  in  the 
derivation  of  norms  for  tne  test.  Sub-tests  were  scored 
on  the  basis  of  the  number  of  items  answered  correctly, 
with  no  correction  for  guessing,  since  when  percentile 
norms  are  used,  such  a correction  need  not  be  made.  — ^ 
The  scores  in  each  sub-test  were  multiplied  by  the 
weighting  factor  for  that  test  (e.g.,  the  score  in 
Sub-test  I is  multiplied  by  4).  Any  score  in  Sub-test  V 
involving  ^ of  a point  was  rounded  off  to  the  next  whole 


1/  Buros,  op.  cit.,  p.  1335 
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number.  The  weighted  scores  of  each  sub-test  were  added, 
and  the  total  constitutes  the  raw  scores.  A frequency- 
distribution  was  made  of  the  results  (see  Table  11 J; 
medians,  means,  and  standard  deviations  for  each  grade 
grouping  (7  and  8,  9 and  10,  11  and  IE,  and  college) 
and  for  the  total  distribution  were  found,  as  well  as 
the  standard  (and  probable)  error  of  a score. 

Percentile  norms  were  found  by  the  following 
formula: 


where  X^  is  the  mathematical  value  of  the  lower  limit 
of  the  interval  in  which  the  desired  centile  value  is 
located;  p is  the  proportion  of  the  distribution  needed 
for  any  particular  centile  value,  as  for  example,  p = .33 
when  C33  is  desired;  N is  the  total  number  of  frequencies 
in  the  distribution;  f^  is  the  number  of  frequencies 
below  the  lower  limit,  X^;  f ^ is  the  number  of  frequen- 
cies in  the  interval  in  which  the  centile  is  located; 
and  i is  the  size  of  the  class  interval. 

Centile  values  from  1-4  and  96  - 99  were  found, 
and  vigintiles  from  5 to  95. 


l/  Peatman,  op.  cit.,  p.  136 
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Z and  T scores  were  found  by  the  following  formulas: 


z - ^ - M 


1/ 


and 


2/ 


where  X is  the  raw  score,  and  M and  (T  are  the  mean  and 
standard  deviation  of  the  distribution  of  which  the  orig 
inal  score  is  a member. 

The  percentile  norms  and  z and  T score  norms  which 
were  obtained  are  listed  in  Table  14  and  Table  15. 


The  interpretation  of  raw  scores  in  terms  of  these 
norms  can  be  easily  explained.  For  example,  if  a 12th 
grade  pupil  earns  a score  of  175,  it  can  be  seen  by  re- 
ferring to  Table  14  that  he  has  a percentile  score  of  65. 
This  means  that  65 °jo  of  12th  grade  pupils  have  scores 
equal  to  or  less  than  175,  and  3 5^>  have  scores  above  175. 
Referring  to  Table  15,  it  is  seen  that  the  pupil’s  z score 
is  .5,  or  one  half  of  a standard  deviation  greater  than 
the  mean  of  the  11th  and  12th  grade  distribution;  and 
his  T score  is  55,  as  compared  with  the  T score  mean 
of  50.  Moreover,  reference  to  the  means  at  the  bottom 


Interpretation  of  Norms 


l/  Greene,  Jorgensen,  and  Gerberich,  op.  ci-c.,  p.  583 
2/  ibid.,  p.  584. 
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Table  14 


Percentile  Score  Norms 


Based  on  1008 

Cases 

foile 

Grades  7 & 8 

Grades  9 & 10 

Grades  11  & 12 

College 

Score 

Raw  Score 

Raw  Score 

Raw  Score 

Raw  Score 
.. 

99 

184 

202 

207 

218 

98 

179 

195 

203 

215 

97 

172 

181 

199 

213 

96 

170 

188 

197 

212 

95 

169 

186 

195 

210 

90 

162 

174 

187 

205 

85 

155 

168 

184 

200 

80 

150 

164 

182 

197 

75 

147 

161 

180 

194 

70 

144 

159 

177 

191 

65 

140 

156 

175 

188 

60 

137 

154 

172 

184 

55 

135 

152 

170 

179 

50 

132 

149 

168 

177 

45 

130 

147 

166 

- * 

174 

40 

127 

145 

162 

172 

35 

124 

141 

159 

167 

30 

120 

135 

155 

163 

25 

116 

130 

151 

159 

20 

112 

126 

146 

154 

15 

108 

121 

139 

150 

10 

102 

114 

133 

144 

5 

94 

106 

121 

139 

4 

91 

104 

117 

138 

3 

89 

101 

114 

137 

2 

84 

98 

111 

134 

1 

79 

94 

96 

131 

N 

476 

176 

206 

150 

Mean 

131.76 

146.81 

163.75 

176.07 

S.D. 

22.54 

23.31 

22.26 

22.05 

Standard  Error  of  a Score:  5.7 

Probable  Error  of  a Score:  3.8 
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Z and  T Score  Norms 
Based  on  1008  Cases 
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College 

T 

Score 

OlOOiOOlO  O iflOiOOiOO 

ao  r-  co  co  io  io  ^ ^ co  co  oj  cm 

£>  lO 

z 

Score 

O lO  O iO  O lO  O inOiOOlOO 

• •••••  • •••••• 

to  WNHHO  O O H H CV]  w « 

1 1 1 1 1 1 

50 

- 176.0 
= 22 .0 

Raw 

Score 

OrHOOJCOr-  CO  lO  ^ CO  CM  rH  O 

^(OWOOCO  D-  CO  LO  CO  CM  rH 

N W W (M  i — 1 i — 1 i — 1 i — 1 rH  rH  i — Ir — 1 i — 1 

1 — 1 

a • 

M a5  O 

0 

^5  S CO 

Grades  11  & 12 

T 

Score 

O WOiOOifi  O lOOiOOlOO 
CO  M CO  CO  lO  LO  ^ ^ CO  CO  CM  CM 

N = 206 
Mean  = 165.75 
S.D.  = 22.26 

O CO 

• • 

LO  CO 

• • • • 

0 0 

p^ 

° ° 

o o 

co  CO 

a5  ® 

cm  <m 

O C 

z 

Score 

OlOOlOOlO  O lO  O lO  O lO  O 

• •••••  • •••••• 

(O  W WHHO  O OHHWWtO 

1 I 1 i 1 1 

Raw 

Score 

i-h  o ao  £>  co  io  ^ whcocoi^ 

CO  rH  O O CO  £>  CO  LO^COrHOCO 

CM  CM  CM  i — ! H H rH  H H i — i H i — 1 

Grades  9 & 10 

T 

Score 

O lO  O lO  O lO  O LOOiOOlOO 

co  r-  co  co  io  10  ^ ^r<  to  co  cm  cm 

N = 176 
Mean  = 146.81 
S.D.  = 23.31 

Standard  Error 
Probable  Error 

z 

Score 

OlOOlOOlO  O LOOiOOlOO 

tOWWHHO  O O H H N OJ  (O 

1 1 1 1 1 1 

Raw 

• Score 

MO  to  W O CO  r-  lO'cr,CV)Oa>0 

H O O)  CC  MO  ^ to  W H O CD  > 

CM  CM  i — 1 i — t i — li — 1 i — 1 H i — 1 r — 1 i — I 

0 

&H  o 

OlOOlOOlO  O lOOiOOlOO 

CO 

o 

co^r-coiom  10  ^ ^ co  co  cm  cm 

oO 

<8 

co  ^ 

£>  iO 

D- 

00 

• » 

Ph 

OlOOlOOlO  O lOOiOOlOO 

rH  00 

CO 

tS3  O 

• •••••  • •••••• 

to  CM 

0 

o 

tow  WHHO  O O H H W W to 

rH 

'O 

CO 

1 1 1 I 1 1 

CO 

05 

O It  I! 

P-i 

O 

0 

c 

£ PH 

a>  co  t>  co  •st<  to  co  oocomo^1 

II  ctf  Q 

05  O 

acor-coio^  to  cm  o o co  r-  co 

0 • 

o 

H H H i — 1 H r 1 i — 1 i — IrH 

N 

M 

S 

CO 

of  either  table  shows  tnat  nis  score  is  above  the  mean 
for  grades  11  and  12,  but  only  one  point  below  tne  av- 
erage score  attained  by  college  students.  Scores  wnicn 
lie  between  values  given  in  the  table  can  be  interpolated. 

As  an  additional  metnod  for  rinding  percentile,  z, 
and  T scores  for  any  raw  scores,  including  those  which 
fall  oetween  values  given  in  the  table,  the  norms  nave 
been  represented  graphically  on  an  Otis  Normal  Percentile 
Chart,  fable  16. 

The  metnod  of  using  this  chart  is  shown  by  tne 
following  example.  To  find  the  percentile  score  for  a 
raw  score  of  200  on  college  level,  consult  the  first 
column  (labeled  score  interval)  to  find  tne  interval 
in  which  200  occurs.  This  score  proves  to  be  tne  highest 
score  in  the  interval  194-200,  so  the  next  step  is  to 
follow  the  line  above  the  interval  across  tne  chart  till 
it  crosses  the  purple  line  which  represents  college  per- 
centile norms.  The  vertical  line  on  tne  cnart  which 
crosses  the  purple  line  at  the  same  point  is  the  85th 
percentile  line,  as  indicated  on  the  cnart.  Thus  tne 
score  of  200  is  in  the  85th  percentile.  Moreover,  by 
following  this  85th  percentile  line  down  1:0  the  oottom 
of  the  charx,  and  extending  it  xo  meet  xhe  linear  scale 
beneath,  it  is  seen  tnat  tnis  is  1 l/20  or  1.05  sigmas 
away  from  tne  mean,  M.  Thus  tne  z score  is  -f-1.05,  and 
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Table  16 


Score 

Intervals 


215  - 

221 

| 208  - 

214 

2Q1  - 

207 

194  - 

200 

187  - 

193 

180  - 

186 

! 173  - 

179 

| 166  - 

172 

1 159  - 



165 

; 152  - 

158 

L 145  “ 

151 

138  - 

144 

131  - 

137 

j 124  - 

130 

! 117  - 

123 

110  - 

116 

103  - 

109 

96  - 

102 

89  - 

95 

82  - 

88 

75  - 81 

68  - 74 

S.D*  Scale 


:rs-6iv"Rucfson,  New  York,  and  Chicago,  Illinois. 
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Otis  Normal  Percentile  Chart 


_ „ , Legend 

Gr.7  & 8 (■ ) ; Gr . 9 & 10 ( );Gr.ll  & 12  (- 


**) ; College  ( — — ' 


the  T score,  counting  each  division  on  the  scale  as  one 
point  (M  being  50),  is  60.5.  For  raw  scores  within  an 
interval,  follow  a horizontal  line  across  the  chart 
which  divides  the  interval  into  the  same  proportionate 
parts  as  the  score  does.  A comparison  of  results  ob- 
tained from  the  chart  with  those  obtained  from  the  tables 
shows  that  the  chart  can  be  used  with  satisfactory 
accuracy. 

Examination  of  the  chart  as  a whole  reveals  that 
the  scores  of  each  grade  group  are  consistently  higher 
than  those  of  the  lower  grade  groups.  Since  pupils 
taking  music  courses  in  the  upper  grades  have  had  more 
formal  musical  experience  than  those  in  the  lower  grades, 
this  would  account  in  large  measure  for  the  increase  in 
norms  by  years  of  school.  However,  there  are  other 
factors  which  might  contribute  to  this  increase.  The 
greater  physical  age  of  pupils  in' the  upper  grades  gives 
them  the  advantage  of  more  years  in  which  to  hear  and 
assimilate  the  music  which  is  so  much  a part  of  every- 
one’s environment.  In  addition,  the  greater  maturity 
of  pupils  in  the  upper  grades  will  to  some  degree  in- 
crease their  sensitivity  to  musical  stimuli. 

The  red  line  on  the  chart,  representing  the  entire 
distribution,  closely  approximates  the  straight  line 
which  is  the  sign  of  perfect  normal  distribution. 
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Reference  to  Table  11  shows  the  consistency  with  which 
the  mean  of  the  grade  group  increases  as  the  grade 
level  is  raised.  The  critical  ratio  for  the  differences 
between  adjacent  means  was  computed;  the  results  (all 
critical  ratios  over  5.0,  indicating  a significant 
difference)  substantiate  what  the  percentile  chart  shows 
pictorially. 
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CHAPTER  VIII 


CONCLUSIONS  AND  SUGGESTIONS  FOR  FURTHER  RESEARCH 

Summary 

The  purpose  of  this  study  has  been  the  construction 
and  validation  of  an  instrument  to  measure  musical  appre- 
ciation in  secondary  schools  and  colleges.  A review  of 
previous  research  in  the  field  revealed  that  a number 
of  psychological  experiments  have  been  conducted  in  tne 
field  of  music.  As  early  as  1892  experiments  were  con- 
ducted, wnich  were  chiefly  concerned  with  the  expressive 
content  of  music.  Later  studies  were  more  concerned 
with  the  effect  of  music  on  the  listener,  but  from  the 
psychologist's  point  of  view,  rather  tnen  tnat  of  the 
music  educator.  The  chief  contribution  of  these  exper- 
iments to  this  study  was  their  delineation  of  the  factors 
involved  in  musical  appreciation. 

Tests  in  the  field  of  musical  appreciation  have 
either  been  based  entirely  on  musical  knowledge  and  in- 
formation, or  have  concentrated  on  one  particular  phase 
of  responsiveness,  such  as  aesthetic  judgment,  associa- 
tions, or  mood.  Such  tests  do  not  take  into  considera- 
tion many  of  the  factors  involved  in  musical  appreciation. 


-82- 


. 

. . . Va  B'^wIcLjS 

- 

. 

•.  ;;  : :.fc  *«  . . t i 

- 

, 

. 

, 

, ' 

- 

■ 

. 

, 1 . . r: 

t ; , j".  tic 

- 


83 


There  have  been  some  tests  in  the  allied  fields  of 
art  and  literature  which  attempt  to  measure  appreciation 
in  these  fields.  The  advances  in  the  testing  of  appreci- 
ation in  art  and  literature  make  more  evident  the  need 
for  an  instrument  that  will  satisfactorily  measure  appre- 
ciation in  music. 

In  order  to  construct  an  instrument  to  measure 
musical  appreciation,  an  analysis  was  made  of  the  various 
factors  involved.  These  were  found  to  be  mood,  imagery, 
association,  rhythm,  timbre  of  instruments,  and  factual 
knowledge.  On  the  basis  of  tnese  factors,  a multiple 
choice  test  was  constructed  consisting  of  five  sub-tests, 
namely:  mood  reaction,  association  and  imagery,  rhythmic 

responses,  feeling  for  the  timbre  of  instruments,  and 
knowledges.  Musical  examples  were  recorded  for  use  in 
the  first  four  sub-tests.  The  test  was  made  approxi- 
mately one  third  larger  than  the  desired  final  length, 
in  order  to  allow  for  items  which  might  have  to  be  dis- 
carded. 

This  test  was  given  to  400  pupils  for  purposes  of 
item  analysis.  Using  these  test  results,  a test  of 
significance  was  made  of  each  item;  items  which  had  a 
critical  ratio  of  2.576  (the  1 °/o  level)  or  more  were 
considered  sufficiently  discriminating  to  be  retained; 
all  others  were  rejected.  The  test  was  then  refined, 
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in  accordance  with  the  results  of  the  item  analysis,  and 
the  musical  examples  were  re-recorded,  doth  on  records 
and  on  wire. 

The  refined  test  was  given  to  1008  pupils,  a repre- 
sentative sampling  of  pupils  in  the  grades  for  which  it 
is  designed.  Information  on  the  pupils1  musical  back- 
ground and  experience  as  given  in  response  to  a ques- 
tionnaire on  the  answer  sheet  was  analyzed  and  tabulated, 
and  the  musical  experience  index  which  was  set  up  as  a 
result  was  used  as  a criterion  in  establishing  the 
validity  of  the  test.  A triserial  correlation  was  com- 
puted between  the  test  scores  and  the  trichotomized 
criterion.  This  resulted  in  a validity  coefficient 

of  r,  . = .82. 
tri 

The  reliability  of  the  test  was  determined  by  the 

"split-half ,T  method.  A product-moment  correlation  of 

scores  obtained  on  odd  numbered  items  and  scores  od- 

tained  on  even  numbered  items  was  computed,  and  found 

to  be  rii  = .93.  Applying  the  Spearman-Brown  Prophecy 
2 2 

Formula  to  this  result,  a reliability  coefficient  of 
r = .96  was  obtained. 

-L  w 

Low  intercorrelations  were  obtained  Detween  the 
various  sub-tests,  indicating  that  these  sub-tests 
tested  distinct  factors.  There  was  no  significant 
correlation  between  the  test  scores  and  intelligence 
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quotients  of  the  pupils  tested,  so  tne  theory  that  the 
test  is  a measure  of  intelligence  can  be  discarded.  On 
the  Dasis  of  this  evidence,  tne  conclusion  was  reached 
that  a test  had  Deen  constructed  which  was  a valid  and 
reliable  measure  of  musical  appreciation. 

As  a final  step  tables  of  norms  were  derived  for 
interpreting  pupil  performance  on  tne  test.  Percentile 
norms  and  z and  T score  norms  were  tabulated  and  also 
represented  grapnically  on  an  Otis  formal  Percentile 
Chart. 


Implications 

With  the  construction  of  tnis  test  wnich  has  met 
the  criteria  of  being  a valid  and  reliable  test  of 
musical  appreciation,  the  conclusion  can  be  drawn  that 
musical  appreciation  can  be  measured  with  reasonable 
accuracy.  Used  as  a tool  in  music  education,  tnis  test 
can  aid  in  measuring  the  pupil's  achievement  in  acquiring 
musical  appreciation.  While  tnis  is  important  to  tne 
individual  pupil  as  a measure  of  his  own  progress,  group 
results  are  equally  important  to  tne  teacher  as  a measure 
of  his  own  success  in  the  teaching  of  musical  apprecia- 
tion. As  a result,  he  may  discover  ways  of  improving 
his  classroom  technique. 

There  has  been,  and  to  a great  extent  continues  to 
be,  an  unfortunate  tendency  to  overemphasize  the 
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accumulation  or  a store  or  factual  information,  even  in 
courses  called  "music  appreciation".  This  may  in  large 
measure  oe  due  to  the  ease  witn  whicn  such  results  can 
be  tested,  and  the  difficulty  of  measuring  growth  in 
other  phases  of  appreciation.  It  is  possible  that  a 
test  such  as  this,  which  will  measure  these  other  phases 
of  musical  appreciation,  will  encourage  methods  of 
teaching  which  will  shift  the  emphasis  from  factual 
information,  and  keep  all  the  elements  in  musical  appre- 
ciation in  their  proper  perspective. 

Since  a high  degree  of  musical  appreciation  is  one 
of  the  fundamental  requirements  for  success  in  the  field 
of  music,  performance  on  this  test  might  well  be  used  as 
one  of  the  criteria  for  admission  to  music  schools  and 
colleges. 

Suggestions  for  Further  Research 

Because  of  the  careful  handling  necessary  for  records 
in  transit,  and  because  of  the  difficulties  involved  in 
re-recording  damaged  or  destroyed  records,  there  were 
geographical  limitations  in  octaining  the  sampling. 

There  is  room  for  further  research  in  extending  the  sam- 
pling to  include  the  various  geographical  sectors  of  the 
country,  and  revising  norms  wherever  wider  sampling 
indicates  the  need  for  such  revision. 

A correlation  study  between  musical  aptitude  tests 
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and  this  appreciation  test  might  prove  worthy  of  investi- 
gation. 

Newer  methods  of  instruction  might  he  evaluated  hy 
means  of  correlation  studies  between  control  and  experi- 
mental groups,  using  this  test  as  a measuring  device. 

As  a result  of  these  evaluations,  new  metnods  and  pro- 
cedures might  be  developed  which  would  make  possible 
greater  advances  among  our  young  people  in  the  developing 
of  a greater  awareness  and  sensitivity  to  the  noolest 
and  best  in  music. 

Throughout  the  ages,  man  has  found  music  to  be 
essential  in  voicing  his  own  innate  sense  of  beauty. 
Music  is  not  a tning  apart  from  man;  it  is  the 
spiritualized  expression  of  his  finest  and  best 
inner  self. 

There  is  no  one  wholly  unresponsive  to  the  elevating 
appeal  of  music.  If  only  the  right  contacts  and 
experiences  are  provided,  every  life  can  find  in 
music  some  answer  to  its  fundamental  need  for 
aesthetic  and  emotional  outlet.  Education  fails 
of  its  cultural  objectives  unless  it  brings  to 
every  child  the  consciousness  that  his  own  spirit  „ , 
may  find  satisfying  expression  tnrough  the  arts.  ±.‘ 


l/  Hazel  N.  Morgan,  Music  Education  Source  Book,  Music 
Educators  National  Conference,  Chicago,  1947,  p.  lv. 
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APPENDIX  A 
THE  INSTRUMENT 


Description  of  Instrument 
Measurement  of  Musical  Appreciation  Part  I 
Measurement  of  Musical  Appreciation  Part  II 
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THE  INSTRUMENT 


The  test  consists  of  five  double-faced  ten-inch 
records  with  recorded  excerpts  and  instructions;  a 
question  booklet  and  answer  sheet  for  Fart  I (Sub-tests 
I - IV);  and  a question  booklet  and  answer  sheet  for 
Part  II  (Sub-test  V). 

The  records  are  as  follows : 

Record  of  Directions  — Directions  and  sample  for 

each  of  the  first  four 
tests • 

Record  of  excerpts  for  Sub-test  I (Mood  Reaction) 

Record  of  excerpts  for  Sub-test  II  (Association 

and  Imagery) 

Record  of  excerpts  for  Sub-test  III  (Rhythmic 

Response ) 

Record  of  excerpts  for  Sub-test  IV  (Timbres  of 

Instruments ) 

The  same  material  is  also  available  on  a continuous 
wire  recording,  with  the  directions  and  samples  for  each 
sub-test  directly  preceding  the  excerpts  for  that  test. 

The  question  booklets  and  answer  sheets  are  on  the 
following  pages.  The  answer  sheets  are  removable  in 
actual  practice;  they  are  attached  here  to  prevent  their 
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MEASUREMENT  OT  MUSICAL  APPRECIATION 


William  R.  Fisher 

Director  of  Music,  Needham  Public  Schools 
Needham,  Massachusetts 


Sub-Tests  I - IV 


;,2  jsoaaiEN?  or  musical  /appreciation 


William  R.  Fisher 

Director  of  Music,  Needham  Public  Schools 
Needham,  Nassachusetts 


Sub-Tests  I - IV 


Sub-Test  I 
Sub-Test  II 
Sub-Test  III 
Sub-Test  IV 


Hood  Reaction 
association  and  Imagery 
Rhythmic  Resoonse 
Timbre  of  Instruments 


Mood  Reaction 


1 


Directions 


Read  the  four  possible  answers  to 
each  item. 

Listen  to  each  musical  example. 

Select  the  word  that  best  describes 
your  feeling  as  you  listened. 

In  the  column  on  th&  answer  sheet, 
directly  to  the  right  of  each  item, 
cross  out  the  letter  representing 
the  word  which  best  describes  how 
the  music  made  you  feel. 

Mark  one  letter  for  each  itom. 

Do  not  leave  any  items  unmarked. 


A.  calm.. 

B.  tender 

C.  gloomy 

D.  disturbed 


2. 

anger «, . . . 

B.  peace. . . . 

C.  shame. . . . 

D.  happiness 

3. 

A.  joy.... 

5.  my story 

C.  devotion 

D.  glee.... 


4. 

A.  confidence 

B.  devotion 

C.  mirth, . . 

D.  joy 


The  sample  below  is  given  30  that 
you  may  know  how  to  do  tho  test. 

Sample: 

Test 


IA 

A. 

devotion 

n 

B . 

sorrow. ....... 

. . . . B 

c. 

Deace 

r \ 

D. 

joy 

5. 

A,  comfort 

B,  grandeur 

C.  sorrow 

D.  happiness 

6. 

A.  triumph 

B.  happiness 

C.  tenderness 

D.  anger 


7. 

A.  happiness 

B.  agony 

C.  worship 

D.  fear. . . 


8. 


A.  impatience 


B , awe . . 

C.  peace 


D.  grief, 


9. 

A.  mirth 

B.  grief 

C . awe . . 

D.  confidence 


* 
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Sub -Test  I 


( continued) 

10. 

A. ,  shsme .... 

B.  mirth. . . . 

C.  reverence 

D.  triumph 

11. 

A.  mystery, 

B . love .... 

G.  longing 
D.  sadness 

12. 

A.  joy.... 

B.  tenderness 

C.  confidence 

D.  fear... 

13. 

A.  fearful 

B.  restful 

C.  gay.... 

B.  sad.... 

14. 

A.  shame.. 

B.  mirth.. 

C.  reverence 

D.  patriotism 

15. 

A.  grief.. 

B.  hope... 

C.  love... 

D.  joy.... 

16. 

A.  anger.. 

B . lo  ve . . . 

C.  sadness 

D.  fear... 

17. 

A.  grief.. 

B.  anger.. 

C.  confidence 

D.  awe.... 

18. 

A.  sadness 

B.  joy* . . . 

C.  reverence 

D.  doom 


Sub-Teat  II 


9* 


Association  and  Imagery- 


Directions 


Head  the  four  possible 
answers  to  each  item. 

Listen  to  each  musical 
example. 

Select  the  phrase  which 
best  describes  what  the 
music  suggested  to  you 
as  you  listened. 

In  the  column  on  the 
answer  sheet,  directly 
to  the  right  of  each 
item,  cross  out  the 
letter  representing 
the  phrase  which  best 
describes  what  the 
music  suggested  to 
you. 

Mark  one  letter  for 
each  item. 

Do  not  leave  any  items 
unmarked. 


Sample: 

Test 

IIA 

A.  in  a cemetery. ..... . A 

F . at  a football  game..  B/ 

C.  in  church.. H 

D.  in  the  country D 


1. 

A.  A moonlight  sail..... 

B.  A child  at  play.. 

C.  An  auto  ride 

D.  A country  fair 

2. 

A.  A funeral  procession...... 

B.  A stroll  on  a rainy  day... 

C.  A military  parade 

D.  A wedding  procession 

3. 

A.  Waltzing  dolls 

B.  March  of  toy  soldiers 

C.  llarch  of  elephants 

D.  Sleeping  dolls 

4. 

A.  In  the  country 

B.  In  the  city 

C.  On  the  ocean. 

D.  By  the  seashore 

5. 

A.  A barnyard 

B.  Leaping  flames 

C.  Thunder  and  lightning..... 

D.  A silvery  moon 

6. 

A.  Indian  dance 

B.  Arabian  danco 

G.  Russian  dance* 

D.  Cuban  dance.. 

7. 

A.  Walking  in  the  country.... 

B.  Playing  in  a school  yard.. 

C.  Singing  a baby  to  sleep... 

D.  Riding  in  the  city 

8. 

A.  A storm  at  sea 

B.  A farmer  plowing  his  field 

C.  A spirit  rising  to  heaven. 

D.  A butterfly  on  the  wing... 

9. 

A.  On  a hilltop 

B.  On  a speedy  train.. 

C.  At  a horse  race 

D.  Beside  a brook............ 





— — 


( continued) 


10. 

A.  Hunters 

B.  Giants.... 

C.  Ballet  dancers 

D.  Dwarfs. 

11. 

A.  A busy  woodpecker 

B.  A fluttering  dove 

C.  A hooting  owl 

D.  A soaring  eagle.... 

12. 

A.  At  a party 

B.  At  church. 

C . At  da\m 

D.  A storm  at  sea. 

13. 

A.  In  a garden 

B.  In  a dark  cave. 

C.  At  a deathbed 

D.  On  a hayride.. 

14. 

A.  At  a picnic 

B.  At  a wedding 

C.  At  the  seashore 

D.  At  a baseball  game. 

15. 

A.  Soldiers  marching  down  the  street 

B.  Lullaby 

C.  Entrance. of  the. circus  queen., 

D.  Processional  of  an  oriental  emperor 

16. 

A.  A horse  and  wagon  riding  along  an  open  road 

B.  A train  riding  through  a tunnel,. 

C.  Witches  riding  broomsticks 

D.  Earners  dancing  a square  dance.... 

17. 

A.  Arabian  dance 

B.  Russian  dance..... 

C.  Chinese  dance 

D.  Indian  dance..... 

18, 

A.  A hero  slaying  a dragon., 

B,  Warriors  riding  flying  horses, 

C,  Fireflies  in  the  night 

D.  Sea-nymphs  swinging  in  the  ocean. 


t 


n 

Sub-Test  III 
Rhythmic  Responses 


1. 

Directions  A. 

B. 

Road  the  four  C. 

possible  answers  D. 

to  each  item. 

2. 

Listen  to  each  A. 

musical  example.  B„ 

C. 


Select  the  word  or  D„ 

phrase  that  best 
describes  what  the  3 „ 
rhythm  suggested  to  A. 

you  as  you  j.is-&en3d«  B. 

C. 

In  the  column  cn  the  D. 

answer  sheet  directly 
to  the  right  of  each  4. 
item,  cross  out  the  A. 

letter  representing  B, 

the  word  or  phrase  C. 

which  best  describes  D. 

what  the  rhythm 
suggested  to  you.  5. 

A. 

Mark  one  letter  for  B, 

each  item.  C. 

D. 

Do  not  leave  any 
items  unmarked.  6. 

A. 

B, 

Sample:  C* 

Test  D. 

IIIA 

A.  on  tip  toes. , . x 7' 

B.  running B A. 

C.  swinging C B, 

D.  skating, D C. 

D„ 

8. 

B. 

C. 

D0 

9. 

A. 

Bo 

C. 

D. 


bouncing 

walking. 

waltzing, 

running. 


skipping  rope 

march  of  the  toys 

skating  on  ice 

march  of  the  elephants 


marching 

jumping. 

swinging 

skating. 


steps  of  a toe  dancer 
dancing  elephants..,. 

galloping  horses 

high  stepping  horses. 


galloping  horses.... 
high  stepping  horses 
running  horses, . . . . . 
trotting  horses 


running, . 
skating. . 
jumping. . 
bouncing. 


swinging 

skipping 

bouncing 

marching 


skipping, 
galloping 
marching, 
running. . 


walking. . 
swaying. . 
jumping. . 
galloping 
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77 


( continued) 


10, 

A.  Hungarian  csardas. 

B.  mazurka., 

C.  jig 

D.  gavotte, 

11, 

A.  waltz 

B . po lka 

C.  mazurka 

D.  gavotte 

IS. 

A.  tango,,,,,... 

B.  Hungarian  csardas. 

C.  minuet 

D.  jig 

13, 

A.  mazurka,,. 

B.  jig 

C.  tango...,.,...,.,. 

D.  waltz 

14, 

A.  waltz............. 

B.  tango 

G.  minuet... ........ . 

D,  gavotte 

15, 

A.  polka.,...,....,,. 

B.  Hungarian  csardas. 

C.  tango,., 

P.  minuet.. 

16, 

A.  mazurka.,, 

B.  schottische. . ... , . 

C.  Hungarian  csardas. 

D.  tango. 

17, 

A.  minuet 

B.  jig 

C.  schottische... 

D.  Swedish  clap  dance 

18. 

A.  tango 

B.  minuet 

C.  jig 

D.  polka 


Sub -Test  IV 
Timbre  of  Instruments 

1.  The  instrument  is  a 

A.  string... 

E.  wood-wind.......... 

C.  brass 

D.  percussion... 

2.  The  instrument  is  a 

A.  string... 

B.  wood-wind 

C.  brass «... 

D.  percussion 

3.  The  instrument  is  a 

A.  string 

B.  wood-wind 

C.  brass 

D.  percussion 

4.  The  instrument  is  a 

A.  string...... 

B.  wood-wind..... 

C.  brass 

D.  percussion 

5.  The  instrument  is  a 

A.  string 

B.  wood-wind 

C.  brass 

D.  percussion..... 

6.  The  instrument  is  a 

A.  string. , 

B.  wood-wind. 

C«  brass... 

D.  percussion , 

7.  The  instrument  is  a 

A.  flute 

B.  violin 

G.  trumpet 

D.  bells.. 

8.  The  instrument  is  a 

A.  viola , 

B.  clarinet ...» 

C.  tympani 

D.  trumpet... 

9.  The  instrument  is  a 

A*  'cello.. 

B.  tenor  saxophone. 

C.  baritone  horn. .......... , 

D.  tambourine 


?r 


Sub-Test  IV 


?? 


( continued) 

10.  The  instrument  is  a 

A.  trombone 

B.  ’celesta 

C.  'cello...., 

D.  baritone  saxc phone 

11.  The  instrument  is  a 

A.  bass  viol 

3.  bassoon 

C.  tympani 

B.  tuba 

12.  The  instrument  is  a 

A.  alto  saxophone.... 

B.  clarinet 

C.  French  horn 

D.  ’cello 

13 . The  instrument  is  a 

A.  flute 

B.  English  horn, 

C.  bassoon 

D.  clarinet 

14.  The  instrument  is  a 

A.  flute 

B.  clarinet 

C.  oboe 

D.  English  horn....... 

15.  The  instrument  is  a 

A.  bass  viol ■ 

B.  ’cello 

C.  viola. 

D.  violin 

16.  The  instrument  is  a 

A.  clarinet. 

B*  baritone  saxophone* 

C,  alto  saxophone 

D.  bass  clarinet 

17.  The  instrument  is  a 

A.  violin... 

B.  viola 

C.  bass  viol • . . 

D.  'cello 

18.  The  instrument  is  a 

A.  bass  drum. 

B.  snare  drum 

C.  tympani 

D.  cymbals. 
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Sub -Test  V 
Musical  Knowledge 


Directions 

Read  the  four  possible 
answers  to  each  item. 

In  the  column  on  the  answer 
sheet,  directly  to  the 
right  of  each  item,  cross 
out  the  letter  reDresonting 
the  correct  answer. 

Mark  one  letter  for  each  item. 
D®  not  leave  any  items  unmarked. 


Sample 


The  "Kyrie",  "Gloria  in  excelsis  Deo" 
"Agnus  Dei"  are  parts  of  the 


"Credo",  "Sanctus" 

A.  opera 

B.  cantata 

C.  mass 

D.  plain-song 
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1. 


2. 


3. 


4. 


5> 


6. 


7. 


8. 


9. 


10. 


11. 


The  tone  of  the  snare  drums,  tympani,  and  cymbals  is  produced 
by  A.  striking........ 

B.  sliding 

C.  bowing..... ... 

D.  fingering.. 

The  conductor  in  conducting  a symphony  orchestra  usually  stands 

on  a A.  podium. 

£.  baton. 

C.  lectern.. 

D.  plectrum.. 

Balance,  proportion,  contrast,  and  unity  are  essential  properties  of 

A.  dynamics 

B , f 

C.  rhythm. 

D , tempo 

The  soprano  voice!  that  is  used  to  sing  high,  ornate,  and 
embellished  melodies  is  known  as  A.  coloratura, 

P.  mezzo 

C.  contralto ...... 

D.  dramatic 

The  orchestral  form  usually  made  up  of  one  long  continuous 

movement  based  upon  one  principal  theme  of  a A,  symphony. 

historic  or  fantastic  nature  is  known  as  a B.  symphonic  poem.... 

C.  modern  suite. 

D.  opera. 

The  keyboard  instrument  first  used  by  Tschaikowsky  in  his 
"Nutcracker  Suite"  to  suggest  the  bell  like  A.  celesta........... 

steps  of  the  fairy  is  the  B.  harpsichord 

C.  glockenspiel 

D«  piano.... 

The  musical  element  that  refers  to  the  instruments  that  are 

used  is  known  as  A.  melody. ......... e * ........ •• 

B.  instrumentation. . 

C . harmony 0 . ....... . 

D.  rhythm. 


The  attempt,  not  to  reproduce  tangible,  or  concrete  things,  but 

the  emotion,  the  feeling,  the  state  of  mind  A,  classicism 

that  is  aroused  by  the  image  *f  a concrete  B.  romanticism 

thing  is  C.  impressionism 

D.  realism, 

The  woodwind  instrument  that  is  not  played  7/ith  a reed  is  the 

A.  oboe. 

B.  clarinet.. 

C.  bassoon-. . 

B . f lu . e.«, ....... .. ...... ...... ...o..  ..»««. «..e* ......... ......... 

The  type  of  music  which  is  written  for  beauty  of  form  and  melody, 

without  in  any  way  suggesting  a A.  program  music...... 

poetic  idea  or  story  is  known  as  B.  absolute  music..... 

G.  realistic  music 

D.  romantic  music 

The  art  of  using  two  or  more  tonalities  (keys)  at  the  same 

time  i3  known  as  A.  poly.onality 

B.  atonality 

C.  polyrhythm 

D.  impressionism 
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12. 


13. 


14. 


15. 


16. 


17. 


18. 


19. 


20. 


21. 


22. 


Greater  political  freedom  resulting  from  the  American 

Declaration  of  Independence  and  A,  classicism 

the  French  Revolution  led  the  B.  romanticism............. 

way  to  the  ‘beginning  of  C.  impressionism...... 

D.  realism 

The  tone  of  the  violins,  violas  and  ’cellos  is  generally 

produced  by  A.  blowing. 

B.  striking. 

C . bowing 

,*  D.  picking..... ' 

The  use  of  folk  songs  and  dances  or  their  characteristic 

rhythms  and  melodic  and  harmonic  A.  pure., 

sequences  is  a popular  means  which  B.  modern 

composers  use  in  making  their  music  C.  nationalistic........ 

D.  absolute 

The  section  in  the  sonata-allegro  form  where  the  real  skill 

of  the  composer  is  shown  A.  statement  or  exposition 

working  out  the  themes  is  B.  coda....... 

known  as  the  C.  restatement  or  recapitulation.... 

D.  -development 

A pleasing  series  of  single  tones  having  some  sort  of  key 

relationship  and  rhythmic  design  A.  melody 

is  known  as  B.  harmony 

G . t empo 

D.  rhythm 

A theme  or  figure,  used  by  Wagner  to  great  effect,  indicating 

or  symbolic  of  a person,  idea,  A.  leitmotif 

emotion,  or  situation  is  called  a B.  coda........ 

C.  cadenza 

D.  interlude 

The  chant-like  unaccompanied  unison  melody  used  in  the  early 

Christian  church  is  called  A.  chorale. ..* 

' B.  hymn 

, C.,  anthem 

D.  plain-song 

The  choir  or  family  of  instruments  in  the  symphony  orchestra 

that  has  the  greatest  number  of  A.-  brass. ..  . 

players  is  the  B.  percussion 

, C.  woodwind.. 

D.  string 

Bach  wrote  two  fugues  and  two  preludes  in  each  of  the  major 

and  minor  keys  to  prove  the  A.  the  piano.. 

possibilities  of  B.  his  own  playing... 

C.  ’’tempered  tuning”.*.... 

D.  the  organ 

The  instrument  usually  used  to  give  brilliant  martial  effects 
in  the  symphony  orchestra  is  the  A.  tuba........ 

B.  French  horn 

C.  clarinet . 

*D.  trumpet 

A contrapuntal  secular  song  with  different  words  for  each  voice 
part  is  a A.  chorale.... 

B.  hymn 

C.  motet......... 

D.  madrigal 
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23.  The  tone  of  the  flutes,  horns,  & trombones  la  produced  by 

A.  humming • 

B.  bowing...... 

C.  blowing....... 

D.  picking 

24.  The  sonata-allegro  form  is  usually  the  form  of  the  first 

movement  of  a A.  suite. ••••••*•••••••  

B • symphonic  poem 

C.  symphony........ 

D,  song  cycle 

25.  The  musical  element  that  refers  to  the  balancing  of  tone 

lengths  within  the  metric  units  A.  rhythm. • o ....... . 

is  known  as  ' B.  harmony* ........  * 

C.  melody........... 

D.  dynamics...* 

26.  The  concert-master  of  a symphony  orchestra  is  chiefly  the 

A.  business  manager 

P.  stage  manager 

C.  Librarian..... 

D.  leader  of  the  first  violin  section 

27.  The  principal  duty  of  an  orchestral  conductor  is  to 

A.  interpret  the  score 

B.  beat  the  time, •••• 

C.  arrange  for  concerts. ••••••••••  ••  •••••*«•»••»••••• 

D*  write  the  program  notes. .. . 

28.  Beethoven’s  "Eroica"  symphony  was  originally  composed 

in  honor  of  A.  Napoleon 

B.  Hitler.... 

C.  Handel 

D.  Goethe........... 

29.  In  general,  any  grouping  of  tones  into  a progression  of 

chords  is  known  as  A.  melody 

B • rhythm 

C.  counterpoint  * ...  

D.  harmony * 

30.  The  classic  symphony  is  usually  unified  by 


A.  key..,.. 

B.  story 

C.  fixed  idea....... 

D.  generating  idea....... 

31.  By  lengthening  the  pipe  (air  column)  of  an  instrument  we 

A.  raise  the  pitch 

B.  lower  the  pitch * 

C.  increase  the  volume 

D.  decrease  the  volume 

32.  If  you  are  listening  to  "polyphonic  music"  you  are 

listening  to  A.  harmonic  music-. »'••••• 

B.  monophonic  music..... 

C.  many- voiced 

D«  modern  music.. .....•*••••••  • 

33.  The  art  of  imitating  the  "thing  itself"  is  called 

A.  impressionism. 

B.  classicism. 

C.  realism..... 

D.  romanticism 
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35. 


36. 


37. 


38. 


39. 


40. 


41. 


42. 


43. 


44. 


Sonata  form  usually  has  ( 

A.  one  movement 

B.  two  movements... 

C.  four  movements 

D.  six  movements, 

One  of  these  instruments  is  not  played  by  means  of  a 
double  reed  A.  clarinet ......  

B.  oboe. 

C.  English  horn 

D.  bassoon. 

The  composer  who  substituted  the  scherzo  for  the  minuet 
in  the  sonata  form  was  A.  Beethoven 

B . Haydn 

C.  Mozart.... 

D.  Brahms 

A symphonic  poem  is  usually 

A.  played. 

B.  recited.. 

C.  danced............ 

D.  sung.... 

The  Latin  word  used  by  composers  to  designate  and  index 
their  works  is  called  A.  oboe. .................... . 

B.  credo 

C.  opus 

D.  etude..,.. 

The  sonata-allegro  form  has 

A.  two  contrasting  themes. 

B.  three  contrasting  themes, 

C.  four  contrasting  themes..... 

D.  five  contrasting  themes.... 

The  art  of  writing  two  or  more  independent  simultaneous 
melodies  is  called  A,  harmony.. 

B.  monophony 

C.  organum. 

D.  counterpoint.............. 

A symphony  differs  from  a sonata  in 

A.  form.,.. 

B.  instrumentation..... 

C.  melody 

D.  tempo, 

A symphonic  poem  is  in 

A.  one  movement 

B.  two  movements •••••••• 

C.  three  movements 

D.  four  movements., 

The  castanets,  cymbals,  triangle,  and  gong  make  no 

A,  rhythm......... 

B,  tun6...... 

C,  sound............ 

D,  noise 

The  most  vital  part  of  primitive  music  was  the 

A.  melody 

B.  harmony..,. 

C.  rhythm 

D.  fcrm 
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Select  the  composition  that  does  not 
belong  in  the  classification  named, 

45.  Oratorio 

A.  Elijah 

B.  Seasons 

C.  Lohengrin.., 

D.  Creation 

46.  Classic  Suite 

A.  French  Suite 

B.  Nutcracker  Suite 

C.  English  Suite 

D.  B minor  Suite 

47.  Art  Song 

A.  The  Wanderer 

B.  The  Two  Grenadiers 

C.  Hark’.  Hark’,  the  Lark 

D.  Santa  Lucia 

48.  Operetta 

A.  H.M.S.  Pinafore. 

B.  Barber  of  Seville.. 

C . The  Mikado 

D.  Patience 

49.  Modern  Suite 

A.  Scheherazade......... 

B.  Peer  Gynt 

C.  Alcina.. 

D.  Firebird 

50.  Spanish  Dance 

A.  Habanera..... 

B.  Far an dole 

C.  Seguidilla 

D.  Minuet. 

51.  Cantata 

A.  Seven  Last  Words... 

B.  Crucifixion..... 

C.  Samson  and  Delilah 

D.  Olivet  to  Calvary 

52.  Opera 

A.  Messiah 

B.  Aida 

C.  Magic  Flute 

D.  Carmen 

53.  Symphony 

A.  Eroica , 

B.  Surprise , 

C.  Unfinished , , 

D.  Moldau ..., 

54.  Folk  Song 

A.  Erlkonig. ............. ........... 

B.  All  Through  the  N ight ............ 

C.  Volga  Boatman. 

D.  Drink  To  Me  Ouly  With  Thine  Eyes., 

55.  Overture 

A.  E^rnont 

B.  1812 

C.  William  Tell 

D.  L* Arlesienne. 
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Select  the  term  most  closely  connected  with: 

56.  Coda 

A.  Introduction, ................ 

5,  dance, «... 

C,  song,. 

D.  ending. ...... 

57.  Scheherezade  Suite 

A.  Aesop's  tables. 

B.  Arabian  Nights.... 

C.  Guli.iver’ s Travels,. ......... .*.4 ...... . 

D.  Child's  Garden  of  Verses,....,..,.....,. 

58.  Syncepetion 

A.  regular  rhythm 

B , lullaby, •••••«.»•• 

C • mar  ch  rhythm 

D*  shifting  of  accent. 

59.  Recitative 

A.  final  chorus,, 

B.  arle... 

C.  Intoned  speech.. 

D.  overture, 

60.  Contrasting  dances  unified  by  key 

A.  overture 

B.  canon...,,, 

C.  classic  suite. 

D.  modern  suite 

61.  Beethoven’s  Fifth  Symphony 

A.  Eroiea. ••••• 

B.  Fate. «••••• 

C • Pastoral.  

D.  Choral 

62.  Tempo 

A.  volume.. 

B.  speed, 

C.  range. 

D.  scale.,... 

63.  Sonata  for  solo  instrument  & orchestra 

A.  sonata..,,. 

B.  concerto 

C • symphony.  

D,  suite. 

64.  Brilliant  display  of  skill 

A.  coda.. 

B.  cadence 

C.  cadenza-, 

D.  cantata....,,..,,..,,.... 

65.  Symphonic  poem 

A.  pure  music. 

B.  absolute  music... 

C.  program  music.. 

D.  dance  music, •• 

66.  Rhapsody 

A.  night  piece...... 

B.  love  song... 

C.  songs  put  together 

D.  dance, 


6? 


, A small  comic  opera  with  spoken  dialogue 
A*  opera  buffa.. • ....«»•••••••. ... 

B.  operetta 

C.  opera  comique..... 

D.  grand  opera 

68.  Two  part  song  form 

A.  A B 

B . »-i.  B A. 

C.  A A 

D.  A B C. 

69.  Story  telling  music 

A.  absolute  music....... 

B.  pure  music....... * 

C.  abstract  music. 

D.  program  music 

70.  Etude 

.i,  dance 

B.  study....... 

C.  night  piece 

D.  march. 

71.  Berceuse 

A.  march 

B.  dance...... 

C.  lullaby........ , 

D.  bassoon 

72.  Religious  drama  set  to  music 

A.  oratorio ; 

B . anthem. «... 

C.  mass 

D.  hymn. 

73.  Beginning  of  opera  & oratorio 

A.  120C 

B.  1400 

C.  1600 

D.  1800 

74.  Introductory  piece 

A.  symphony. 

B.  fugue...... 

C.  rhapsody,.... 

D.  overture 

75.  Secular  drama  set  to  music 

A.  oratorio. 

B.  cantata..,. 

C»  fugue 

D.  opera. 

76.  Beethoven*  s only  opera 

A,  Coriolanus.. 

B.  Fidelio 

G.  Prometheus 

D*  Eroica;... 

77.  Contrasting  pieces  unified  by  story 

A.  classic  suite........... 

B.  modern  suite 

C.  symphonic  poem 

D.  symphony.  
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78.  Form 

A.  tune 

B.  pattern 

C.  volume.. ..... ♦ 

D.  rhythm 

7S.  Requiem  Mass 

A.  marriage 

Bo  christening 

0.  death. . . , 

D,  communion 

80.  Dynamics 

A.  speed 

B.  rhythm... 

C.  melody... 

D.  volume. ............. , 

81.  Chamber  music 

A.  symphony....*...*..., 

B.  string  quartet.*...., 

C.  symphonic  poem....... 

D.  modern  suite. ....... , 

82.  Entr’acte 

A.  study 

B.  Polish  dance 

C.  slow... 

D.  interlude............ 

83.  Spiritual 

A.  Russian  song, 

B.  Indian  dance 

C.  Negro  dance 

D.  Religious  Negro  song, 
84 c Serenade 

A.  evening  love  song... 

B.  march 

C.  song  of  victory..... 

D.  lullaby 

85.  Aria 

A.  dance ...... . 

E.  intoned  speech...... 

C.  march 

D.  vocal  air  or  melody. 

86.  Nocturne 

A.  lively  dance. 

B.  night  piece 

C,  folk  song. ........ „ , 

D,  "show”  piece........ 

87.  Carillon 

A.  an  interlude ........ 

B.  set  of  bells 

C.  a song 

D.  a string  instrument. 

88.  Andante 

A.  rather  slowly 

B.  fast 

C.  loud 

D.  very  slowly., 
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89.  Ballad 

A.  dance.. .............. . 

B.  folk  song. ............ 

C.  march 

D.  narrative  song 

90.  Ballet 

A.  narrative  song 

B.  a story  told  in  dance. 

C.  folk  song...., 

D.  night  piece 

91.  Allegro 

A.  lively........ 

B.  slowly..., 

C.  soft 

D.  loud 

92.  Sonata  for  full  orchestra 

A.  symphonic  poem 

B.  symphony 

C.  concerto. ............ . 

D.  sonata. 

93.  Fugue 

A.  lively....... 

B.  flight  or  chase 

C.  lullaby 

D.  songs  put  together..,. 

94.  Oriental  pentatonic  scale 

A.  3 tones... 

B.  5 tones. 

C.  7 tones 

D.  13  tones, 

95.  Chanson 

A.  a song....... 

B.  a dance. 

C.  set  of  bells. 

D.  an  altered  interval... 

96.  Ensemble 

A.  solo 

B.  together. ............ . 

C.  slow., 

D.  chime. 

97.  Antiphonal  singing 

A.  "singing  apart”. ..... , 

B.  answering  back  & forth 

C.  repeated  singing,...., 

D.  chase  of  melody 

98.  Chanty 

A.  lullaby, ........ ...... 

B.  ballet...... 

C.  cowboy...... 

D.  song  of  the  sea 

99.  Beethoven  wrote 

A.  3 symphonies. 

B.  6 symphonies.. 

C.  9 symphonies.,..,.,,.. 

D.  13  symphonies 


Page  10 


//X 


Select  the  person  most 
closely  connected  with: 

100.  Symphonic  Jazz 

A.  Carpenter .......... . 

B.  MacDowell. 

C.  Ravel, 

D.  Gershwin. .......... • 

101.  Music  Drama 

A.  Mozart.. • . 

B.  Brahms. 

C.  Wagner 

D.  Debussy 

102.  Woodland  Sketches 

A.  Carpenter.., 

B.  Franck.............. 

C.  MacDowell........... 

D.  Cadman 

103.  Romanticism 

A.  Bach. . . 

B.  Haydn....... 

C.  Handel. 

D.  Schubert.. 

104.  Meistersingers 

A.  Adam  de  la  Hale 

B.  Richard  Strauss..,.. 

C.  Hans  Sachs 

D.  Jacob  Arcadelt...... 

105.  Saviour  of  church  music 

A.  Palestrina 

B.  Bach....,....,,*.... 

C.  Luther. 

D.  Arcadelt., 

106.  Piano  compositions 

A.  Chopin. 

B.  Paganini 

C.  Tschaikowsky. . ... . .. 

D.  Berlioz 

107.  Opera 

A.  B«ch. 

E.  Verdi 

C.  Brahms 

D.  Chopin 

108.  Art  Song 

A.  Schubert ........... . 

B • Wagner 

C.  Prokofieff 

D.  Bach.. 

109.  Purest  of  church  modes 
A.  Mar cellus ........... 

B«  Pius, ..,.«••• ....... 

C.  Ambrose. 

D,  Gregory 

110.  Impressionism 

A.  Tschaikowsky, ...... • 

B.  Debussy.. ......  ..... 

C.  Liszt. 

D.  Grieg......... 
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111.  Russian.  Nationalism 

A,  Glinka 

-B.  Debussy,,..,.... 

C.  Verdi ........... 

D.  Dukas 

112.  "Waltz  King" 

A.  Oscar  Straus...., 

B.  Johann  Strauss.., 

C.  Richard  Strauss., 

D.  Ludwig  Straus..., 

113.  March 

A.  Ravel 

B.  Rachmaninov 

C.  Gershwin 

D.  Sousa 

114 . Founder  of  Impressionism 

A.  Schubert 

B.  Dukas 

C.  Prokofieff 

D.  Debussy 

115.  Classicism 

A.  Schumann 

B.  R.  Strauss 

C.  Mozart 

D.  Dukas 

116.  Piano  making 

A.  Mozart. 

B.  Nicolai 

C.  Saint-Saens 

D.  Cristofori 

Ilf.  "Peoples  Mass" 

A.  Luther 

B.  Palestrina 

C.  Bach. 

D.  Stravinsky ...., 

118.  Violin  making 

A.  Prokofieff... 

B.  Cristofori. ....... . 

C.  Stradivari... 

D.  Wolf-Ferrari 

119.  Norwegian  Nationalism 

A.  Brahms. 

B.  Grieg. 

C.  Glinka 

D.  Chopin , 

120.  Father  of  the  symphony 

A.  Monteverdi ......... 

B.  Haydn 

C.  Beethoven. 

D.  Tschaikowsky 
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DIRECTIONS  FOR  ADMINISTERING  AND  SCORING  TEST 


Directions  for  Administering  Test 


Equipment  needed 


1. 

2. 


3. 

4. 

5. 

6. 

7. 


Electric  record  player  in  good  playing  condition 
or  a wire  recording  machine. 

Set  of  test  records 

a.  Record  of  directions. 

b.  Record  for  Sub-test  I. 

c.  Record  for  Sub-test  II. 

d.  Record  for  Sub-test  III. 

e.  Record  for  Sub-test  IV. 

Question  booklets  for  Part  I (Sub-tests  I-IV). 
Answer  sheets  for  Part  I. 

Question  booklets  for  Part  II  (Sub-test  V). 
Answer  sheets  for  Part  II. 

Pencils  to  mark  responses. 


Spool  of  wire 
on  which  the 
directions  and 
or  excerpts  are 
recorded. 


Size  of  groups  tested 


The  size  of  the  group  tested  will  be  limited  only 
by  the  acoustical  properties  of  the  room;  every 
pupil  must  be  able  to  hear  the  records  clearly  at 
all  times. 

Time  allotment 


Part  I (Sub-tests  I-IV) 

35  minutes  to  take  test  plus  5 minutes  to  fill 
in  blanks . 

Part  II  (Sub-test  V) 

38  minutes  to  take  test  plus  2 minutes  to  fill 
in  blanks. 

General  directions  for  Part  I (Sub-tests  I-IV) 

1.  Distribute  the  answer  sheets  for  Part  I.  Say  to 
the  students,  "Do  nothing  with  the  answer  sheet 
until  I give  the  signal. iT 
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2.  After  the  answer  sheets  have  oeen  distributed, 
say,  "Fill  in  the  blanks  for  name , age,  etc." 

3.  Distribute  the  question  "booklets  for  --art  A.  Say 
to  the  students,  "Do  nothing  with  the  question 
booklet  until  I give  the  signal. :r 

4.  After  the  question  booklets  have  been  distributed, 
say,  "Open  the  booklet  from  the  back  and  place  the 
answer  sheet  Just  inside  the  rear  cover.  Je  sure 
to  line  up  the  answer  sneet  with  the  questions  in 
booklet. " Demonstrate  the  correct  procedure. 

5.  After  the  answer  sheets  are  inserted  in  booklet, 
s ay , "Turn  to  Test  I,  Be  sure  to  nark  only  on 
ans we r sheet • " 

*6.  flay  "Directions  for  Sub-test  I".  Lift  needle 
off  record  at  end  of  directions. 

*7.  Play  "Sub-test  I".  (both  sides) 

*8.  Repeat  the  same  procedure  for  Sub-tests  II,  III, 
and  IV. 

9.  After  Sub-test  IV  has  been  completed  say,  "Remove 
answer  sheets  from  booklets." 

10.  Collect  answer  sheets. 

11.  Collect  question  booklets. 


General  directions  for  Part  II  (Sub-test  V) 


1.  Distribute  the  answer  sheets  for  Part  II.  Say  to 
the  students,  "Do  nothing  with  the  answer  sheet 
until  I give  the  signal." 

2.  At' ter  the  answer  sheets  have  been  distributed, 
say,  "Fill  in  the  blanks  for  name,  age,  etc." 

3.  Distribute  the  question  booklets  for  Fart  II.  Say 
to  the  students,  "Do  nothing  with  the  question 
booklet  until  I give  the  signal." 

4.  After  the  question  booklets  hive  been  distributed, 
say,  "Open  the  booklet  from  the  back  and  place  the 
answer  sheet  just  inside  the  rear  cover.  Re  sure 
to  line  up  the  answer  sheet  with  the  questions  in 
bookie  tT* 7 8 9 * 11  Demonstrate  the  "correct  procedure. 

5.  After  the  answer  sheets  are  inserted  in  booklet, 
say,  "Open  booklet  to  page  of  directions."  Read 
the  directions  aloud  to  the  class. 

6.  After  reading  the  directions,  say,  "Turn  to  page 
one  and  begin  to  answer  the  questions'!  De  sure  to 

mark  only  on  answer  sheet." 

7.  After  38  minutes  say,  "Remove  answer  sheets  from 
booklets . " 

8.  Collect  answer  sheets. 

9.  Collect  question  booklets. 

* When  using  wire  recording  of  test,  omit  steps  6,7,  and  8, 

and  play  complete  wire  recording  instead. 


Directions  for  Scoring  Test 
The  test  is  scored  by  means  of  two  masks,  one  for 
each  part  of  the  test.  The  holes  in  the  mask  are  so 
arranged  that  when  the  mask  is  placed  over  the  answer 
sheet,  the  correct  responses  appear  in  the  holes.  If 
the  pupil  has  marked  the  correct  response,  this  can  be 
seen  at  a glance. 

If  the  correct  response  has  not  been  marked,  mark 
it  through  the  hole  in  the  mask  with  colored  pencil. 

Tally  these  colored  marks  for  each  individual  sub-test 
and  subtract  from  the  number  of  items  in  the  sub-test. 
Place  the  results  in  the  spaces  provided  in  column  one 
of  the  scoring  box  on  the  answer  sheet  to  Part  I.  Multi- 
ply the  score  obtained  in  each  sub-test  by  the  number 
(weighting  factor)  in  the  next  column,  placing  the  produc 
in  the  last  column,  marked  "weighted  score".  (If  there 
are  any  half-points  in  Sub-test  V,  round  it  out  to  the 
next  whole  number. ) Add  the  numbers  in  this  column  to 
obtain  the  raw  score. 

Interpretation  of  Results 
The  interpretation  of  the  raw  scores  is  explained 
in  detail  in  Chapter  VII  on  norms. 
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